Based on my understanding they create the new api everytime we visit the site from the data from this endpoint /api/autheticate/prove and they add authorization header which is basically the api made from previous endpoint data which needs to be refreshed after certain time.so u can not scrape from basic request because either u need to decipher the api or u need to manually add header on each request which is not possible I guess.
but what u can do is u can use their old website and gather as much data as u like from webscraping but be careful u might have legal problem if u use toomuch.
You need to pay them for the API access. Until few days ago, you could access the new website’s back-end API but they’ve now implemented an authorization system. There’s no straightforward free access now. Maybe someone here knows how to get the authorization without paying. I don’t come from technical background.
2 comments
Based on my understanding they create the new api everytime we visit the site from the data from this endpoint /api/autheticate/prove and they add authorization header which is basically the api made from previous endpoint data which needs to be refreshed after certain time.so u can not scrape from basic request because either u need to decipher the api or u need to manually add header on each request which is not possible I guess.
but what u can do is u can use their old website and gather as much data as u like from webscraping but be careful u might have legal problem if u use toomuch.
You need to pay them for the API access. Until few days ago, you could access the new website’s back-end API but they’ve now implemented an authorization system. There’s no straightforward free access now. Maybe someone here knows how to get the authorization without paying. I don’t come from technical background.