我正试图从网站上抓取电话号码，但只有当我点击第一个号码时，这些号码才会出现.换句话说，手机将隐藏在HTML码中，当我点击它时，它就会出现.你能帮帮忙吗？ 我使用了以下代码:
import requests
from bs4 import BeautifulSoup
url = "https://hipages.com.au/connect/makermanservices"
req = requests.get(url).text
soup = BeautifulSoup(req,"html.parser")
phone = soup.find('a', class_='PhoneNumber__MobileOnly-sc-4ewwun-1 izNnbI phone-number__mobile')
print(phone)
稍微黑客一下，就可以在bs4和pandas的帮助下得到电话号码.
例如:
import json
import re
import pandas as pd
import requests
from bs4 import BeautifulSoup
url = "https://hipages.com.au/connect/makermanservices"
script_text = "window.__INITIAL_PROPS__="
headers = {
"User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/112.0.0.0 Safari/537.36 Edg/112.0.1722.48",
}
soup = BeautifulSoup(requests.get(url, headers=headers).content, "lxml")
script = soup.find("script", string=lambda t: t and script_text in t)
data = json.loads(re.search(script_text + r"(.+)", script.string).group(1))
df = (
pd.read_json(data)
["fetchKey-7-0-0_/connect/makermanservices"]
["site"]
["primary_location"]
["phone"]
)
print(df)
这应该打印出来:
1800 801 828