This is an unprecedented time in our history. The present novel coronavirus (COVID-19) pandemic is having an impact on the health of our loved ones, the businesses we rely upon, the health of the global economy, and the way we live our daily lives.

As we all continue to navigate through these tough times, those on the front lines - including the health care professionals, researchers, and government organizations need quick, easy access to real-time website scraping data to better understand the situation for well planning, reporting, dashboards for decision makers to come up with their plans.

This type of data scraping is what Agenty do best, and as an web scraping company, we are committed to providing whatever assistance we can in this area.

Web scraping agents to help in the COVID-19 fight

Today, we’ve published 5 scraping agents in a public data-set to help everyone to get the data easily, without learning scraping techniques and creating a new scraping agent for COVID-19 websites.

You can login to your account > go to public dataset > and filter with “COVID-19” tags to use any of these agent for FREE.

COVID-19 All cases

This web scraping agent extract the total cases, recovery, and deaths every hour.

COVID-19 cases by countries

This web scraping agent extract the country wises cases every hour. The fields includes

COVID-19 cases by US states

This scraping agent download the state level reports :

COVID-19 report from CDC website

However CDC website not updated frequently, but it’s good to get the official source of confirmed cases on daily basis.

COVID-19 news

This scraping agent aggregate the COVID-19 related top news from thousand of English news websites every hour.

Using the API

You can use the Agenty API in any programming language to pull the agent result using a simple HTTP GET request and passing the agentId and apiKey variables.

Here is the example code in curl

Sample code

curl -X GET -H "Content-type: application/json" 
 'https://api.agenty.com/v1/results/{AGENT_ID_HERE}?apikey={API_KEY_HERE}&offset=0&limit=1000'

Response

{
  "total": 1,
  "limit": 1000,
  "offset": 0,
  "returned": 1,
  "result": [
    {
      "cases": "68,440",
      "deaths": "994"
    }
  ]
}

Wrap-up

We are working to find new ways to meet your needs and will draw on our technology and resources to make a difference for you. If you’d like additional help or guidance on using Agenty to scrape important data about the pandemic, contact support@agenty.com and we are here to help you.

Additionally, If you are a non-for-profit organization and need more resources to access COVID-related data. We are offering Agenty basic-plan free for a year and then subsequent discount if you need to continue your research after the outbreak.

How to scrape COVID-19 data from websites?