Website URL & Content Scraper API

API Endpoint Specifications

  • Endpoint Path: /api/1/webScraper
  • Type of Data: JSON & 20/minute
  • Data Source: Source from Internet
  • Request Limit: 500 request/month
  • Script & Integration: Code to integrate with cURL, JS, Python, Ruby, Php, Node.js, Java, .NET, Rust, Go, Typescript
Website URL & Content Scraper API Endpoint Basic Info

API Endpoint Path

required

Website Content & URLs Scraper API

api/1/webScraper


Call Method

Required

GET

Type of Data Return

JSON

Output structured JSON data on Website content


Available API Arguments & Parameters

token

required

BUYFROMLO API token. Free and paid subscription APIs are both available: /api/1/webScraper, and accessible to on-site APP on /app/1/webcontentscraper as well

url

required

Input the target page url

type

required

Options: allURL, metaAndContent


lang

Optional

Input the target site language iso-code. The default value is en


Website Content & URLs Scraper API

api/1/webScraper

TRY IT OUT

Code Integration and Response

Python Code Sample


import requests

apiendpoint = "https://api.buyfromlo.com/api/1/webScraper?"

## Required Arguments & Parameters ##

token = ""your buyfromlo token""
url = ""Input a category url""
type = "Select one type from two: metaAndContent, or allURL"

## Optional Argument ##
lang = "the target site language. The default language is English"

data="url=" + url + "&type=" + type + "&lang=" + lang
headers={"Authorization": "Bearer " + token}

## Call the api ##
response = requests.get(apiendpoint + data, headers=headers)
print(response.status_code)
print(response.json())

JSON Response Sample


{
    "Metatag Title": metaData['title'] (string),
    "Metatag Description": metaData['description'] (string),
    "Release Date": metaData['date'] (string),
    "Article Content": metaData['text'] (string),
    "Input URL": url (string),
}