Welcome! Log In Create A New Profile

Advanced

Use nginx to return a scraped copy of another site

Tony Mobily
November 10, 2022 07:52AM
Hi,

I have a web site a.com. I own it and run it, but I don't have access to
the backend. The pages served by a.com are normal plain HTML pages.

I want to run b.com as a duplicate of a.com, with nginx acting as a proxy.
The contents would be identical; however, I would apply some minor
modifications to the HTML. Basically, when somebody requests
b.com/something.html, the server in b.com would make a request to a.com
(asking for /something.html) and then respond with the contents (after
making small modifications, probably using
nginx.org/en/docs/http/ngx_http_sub_module.html#sub_filter).

The a.com site has cookies etc. So, nginx should proxy those too.

Is this possible with nginx? Is there an example configuration I can use as
a starting point?

Merc.
_______________________________________________
nginx mailing list -- nginx@nginx.org
To unsubscribe send an email to nginx-leave@nginx.org
Subject Author Posted

Use nginx to return a scraped copy of another site

Tony Mobily November 10, 2022 07:52AM

Re: Use nginx to return a scraped copy of another site

Francis Daly December 01, 2022 02:44PM



Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 71
Record Number of Users: 6 on February 13, 2018
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready