Website Interaction GPYC Practice Questions (Page 8)

Questions 36–40

1. 36expert · hard

   A Python script must scrape a website that uses infinite scrolling to load content via JavaScript. The script must extract all items from the page. Which approach is most reliable?

   • AUse the requests library to send a POST request to the API endpoint that the infinite scroll uses.
   • BUse requests.get() to fetch the initial HTML and parse it with BeautifulSoup.
   • CUse Selenium to scroll the page repeatedly, wait for new content to load, and collect items until no new items appear.
   • DUse requests.get() to fetch the page and then use a JavaScript engine like PyMiniRacer to execute the scripts.
   Reveal Solution Discussion Select an answer first
2. 37application · medium

   A Python script scrapes a website that has a robots.txt file disallowing /private/ but allowing /public/. The script must only scrape /public/ pages and avoid being blocked. Which approach is appropriate?

   • ASet a custom User-Agent header and add a random delay between requests, but ignore robots.txt.
   • BUse Selenium to render the page and extract data, but do not check robots.txt.
   • CUse a session object and maintain cookies, but do not check robots.txt.
   • DUse the urllib.robotparser module to parse robots.txt and check if the URL is allowed before making the request.
   Reveal Solution Discussion Select an answer first
4. 38foundation · easy

   By default, how does the requests library handle HTTP redirects (3xx status codes)?

   • AIt raises an exception
   • BIt follows them automatically
   • CIt ignores them and returns the 3xx response
   • DIt requires manual handling with a loop
   Reveal Solution Discussion Select an answer first
5. 39application · medium

   A Python script must authenticate to a REST API that uses OAuth 2.0 with client credentials. The API returns an access token that expires in 3600 seconds. The script runs periodically and must minimize the number of token requests. Which approach should the script use?

   • ACache the token with its expiry time and reuse it until it is close to expiring, then request a new one.
   • BRequest a new token on every run and store it in memory for the duration of the run.
   • CHardcode the access token in the script and only update it manually when it expires.
   • DUse the refresh token to get a new access token on every run, ignoring the cached access token.
   Reveal Solution Discussion Select an answer first
6. 40foundation · easy

   In the HTTP request/response cycle, which component is responsible for initiating the communication by sending an HTTP request?

   • AThe web server
   • BThe TCP handshake
   • CThe client
   • DThe DNS resolver
   Reveal Solution Discussion Select an answer first