我是python的初学者,并使用scrapy从以下网页http://www.basketball-reference.com/leagues/NBA_2015_games.html提取链接。
我写的代码是
from scrapy.contrib.spiders import CrawlSpider, Rule
from scrapy.contrib.linkextractors import LinkExtractor
from basketball.items import BasketballItem
class BasketballSpider(CrawlSpider):
name = 'basketball'
allowed_domains = ['basketball-reference.com/']
start_urls = ['http://www.basketball-reference.com/leagues/NBA_2015_games.html']
rules = [Rule(LinkExtractor(allow=['http://www.basketball-reference.com/boxscores/^\w+$']), 'parse_item')]
def parse_item(self, response):
item = BasketballItem()
item['url'] = response.url
return item
我通过命令提示符运行此代码,但是创建的文件没有任何链接。有人可以帮忙吗?
rules = [
Rule(LinkExtractor(allow='boxscores/\w+'), callback='parse_item')
]
本文收集自互联网,转载请注明来源。
如有侵权,请联系[email protected] 删除。
我来说两句