Re: How to get a webpage with Lua Socket ?

[Geoff Smith <spammealot1@...>]

Hello Paul

Thanks very much for the reply.

I get  "module 'ssl.https' not found:" When I try

https = require("ssl.https")".

I should have mentioned I am using LuaSocket 2.0.2.  Do I need to get a more up to date version of LuaSocket, or is 2.0.2 OK and I need to download an additional SSL library ?

Regards Geoff 

________________________________________
From: lua-l-bounces@lists.lua.org <lua-l-bounces@lists.lua.org> on behalf of Paul K <paul@zerobrane.com>
Sent: 24 November 2015 20:03
To: Lua mailing list
Subject: Re: How to get a webpage with Lua Socket ?

Hi Geoff,

> local webText = http.request([[https://www.betfair.com/exchange/]])

You should be using https.request (note *https*) after you do "local
https = require("ssl.https")". http.request actually connects to port
80 (so it does http:, even though it looks to you like https:) and you
get redirected to https:, which looks like the same URL.

Paul.

On Tue, Nov 24, 2015 at 11:47 AM, Geoff Smith <spammealot1@live.co.uk> wrote:
> Hi
>
>
> I have used Lua ocket to get a few web pages downloaded in the past without
> a problem, but have hit a snag with a specific webpage I am trying to
> download.
>
> I am trying to extract some data from the Betfair homepage.
>
>
> local webText = http.request([[https://www.betfair.com/exchange/]])
>
>
> I get back a small chunk of html which contains the text "The document you
> requested has moved to a new location.  The new location is
> "https://www.betfair.com/exchange/";
>
>
> This is the exact url link I passed to the function, so cant understand why
> the problem is occurring.  If I view that site in any browser it displays
> the full web page without needing me to register or login or anything like
> that.
>
>
> So the Server is detecting I am not using a browser and not giving me the
> page I require. I have tried tinkering with the headers sent by LuaSocket to
> make it look more like a Firefox request but to no avail.
>
>
> Could anyone offer a suggestion as to what I need to do to fix this problem
> please.
>
>
> Thanks for any assistance.
>
>
> Regards Geoff