Re: How to get a webpage with Lua Socket ?

[Choonster TheMage <choonster.2010@...>]

On 25 November 2015 at 06:47, Geoff Smith <spammealot1@live.co.uk> wrote:
> Hi
>
>
> I have used Lua ocket to get a few web pages downloaded in the past without
> a problem, but have hit a snag with a specific webpage I am trying to
> download.
>
> I am trying to extract some data from the Betfair homepage.
>
>
> local webText = http.request([[https://www.betfair.com/exchange/]])
>
>
> I get back a small chunk of html which contains the text "The document you
> requested has moved to a new location.  The new location is
> "https://www.betfair.com/exchange/";
>
>
> This is the exact url link I passed to the function, so cant understand why
> the problem is occurring.  If I view that site in any browser it displays
> the full web page without needing me to register or login or anything like
> that.
>
>
> So the Server is detecting I am not using a browser and not giving me the
> page I require. I have tried tinkering with the headers sent by LuaSocket to
> make it look more like a Firefox request but to no avail.
>
>
> Could anyone offer a suggestion as to what I need to do to fix this problem
> please.
>
>
> Thanks for any assistance.
>
>
> Regards Geoff

Are you sure the page still exists at that URL? I tried opening it
with Chrome and Internet Explorer and downloading with LuaSocket and
LuaSec and got the same "Sorry, we can't find this page" message each
time.

Regards,
Choonster