How to scrape a website that uses session login using php

Question

i have been trying to scrape a website which requires login. Login in POST Request, I have done it successfully. But the links after logged in doesn't gets scraped. It Says " Session Expired" when scraped in curl PHP. I don't know what happens there. Please let me know and solve the problem if possible.

I had scraped many websites but this is little bit different in strategy.

url:http://www.example.com/login --> Required post request with username and password as parameters. Now the problem comes!

Thanks in advance

Try reading this too! [GitHub Link](https://gist.github.com/anchetaWern/6150297) — Jonathan Yaniv Ben Avraham, May 26 '16 at 14:49

score 7 · Accepted Answer · edited May 23 '17 at 12:03

7

You should accept the session cookie, store it, and resend it on the next request.

Keeping session alive with Curl and PHP

edited May 23 '17 at 12:03

Community

1
1

answered May 26 '16 at 14:48

Viktor Koncsek

564
3
13

Thanks Viktor!! It Worked ! – abdul riyaz May 26 '16 at 15:28

How to scrape a website that uses session login using php

1 Answers1