Python爬虫 亚马逊网页的爬取

import requests

url=”https://www.amazon.cn/gp/product/B01M8L5Z3Y”

r=requests.get(url)
print(r.status_code)

import requests

kv = {“user-agent”: “Mozilla/5.0”}
url=”https://www.amazon.cn/gp/product/B01M8L5Z3Y”
try:
    r=requests.get(url,headers=kv)
    r.raise_for_status()
    r.encoding=r.apparent_encoding
    print(r.text[:1000])
except:
    print(“爬取失败”)

 但是这次结果爬取到的并不是想要的结果，还是被服务器判断为自动程序：

import requests
from bs4 import BeautifulSoup
kv = {“user-agent”: “Mozilla/5.0”}
cookie = {
“cisession”:”19dfd70a27ec0eecf1fe3fc2e48b7f91c7c83c60″,
“CNZZDATA100020196″:”1815846425-1478580135-https%253A%252F%252Fwww.baidu.com%252F%7C1483922031”,
“Hm_lvt_f805f7762a9a237a0deac37015e9f6d9″:”1482722012,1483926313”,
“Hm_lpvt_f805f7762a9a237a0deac37015e9f6d9″:”1483926368”
}
url = ‘https://www.amazon.cn/gp/product/B01M8L5Z3Y’
r = requests.get(url,cookies=cookie,headers=kv)
r.encoding = r.apparent_encoding
print(r.text[:1000000])