So after some debugging, it looks like when you use request_oauth_on_install you must set callback_url along with it. As I had the url and redirect_url fields set I got confused by the error message (see screenshot) and it was not obvious to me that callback_url URL was missing :). Now that I solved the issue it looks obvious of course 
Thanks!
