API:Scraper
APIエンドポイントパス
必須
Web サイトのコンテンツと URL スクレイパー API
api/1/webScraper
メソッドの呼び出し
必須
GET
返されるデータの種類
JSON
Web サイトのコンテンツに構造化された JSON データを出力する
token
必須
BUYFROMLO API トークンを購入します. 無料および有料のサブスクリプション API は両方とも利用可能です: /api/1/webScraper からアクセスできます. - /app/1/webcontentscraper のサイト APP も同様
url
必須
対象ページのURLを入力してください
type
必須
オプション: allURL, metaAndContent
lang
オプション
ターゲット サイトの言語 ISO コードを入力します. デフォルト値はenです
Web サイトのコンテンツと URL スクレイパー API
api/1/webScraper
Python コードサンプル
import requests
apiendpoint = "https://api.buyfromlo.com/api/1/webScraper?"
## Required Arguments & Parameters ##
token = ""your buyfromlo token""
url = ""Input a category url""
type = "Select one type from two: metaAndContent, or allURL"
## Optional Argument ##
lang = "the target site language. The default language is English"
data="url=" + url + "&type=" + type + "&lang=" + lang
headers={"Authorization": "Bearer " + token}
## Call the api ##
response = requests.get(apiendpoint + data, headers=headers)
print(response.status_code)
print(response.json())
JSON 応答サンプル
{
"Metatag Title": metaData['title'] (string),
"Metatag Description": metaData['description'] (string),
"Release Date": metaData['date'] (string),
"Article Content": metaData['text'] (string),
"Input URL": url (string),
}
The Website URL & Content Scraper API is a tool that allows you to extract specific text and image content from specific websites, including the website's sitemap if applicable.
By using the Website URL & Content Scraper API, you can automate the process of collecting data from websites, save time and effort, and improve the accuracy of your data.
The Website URL & Content Scraper API works by sending a request to a specific website and extracting the desired data from the website's response.
To scrape the specific page content, you need to input the language ISO code and the website page URL.
The Website URL & Content Scraper API can scrape a variety of data, including page metatag title & description, main body content, and image URLs.
The request limit for the Website URL & Content Scraper API is 500 requests per month.
Yes, the Website URL & Content Scraper API can be integrated with your existing applications using code written in cURL, JS, Python, Ruby, Php, Node.js, Java, .NET, Rust, Go, or Typescript.
Both free and paid subscription APIs are available for the Website URL & Content Scraper API.
You can find more information about the Website URL & Content Scraper API in the BUYFROMLO API documentation.
To get started with the Website URL & Content Scraper API, you can visit the BUYFROMLO website and sign up for a free account.
