老师我这图片下载不了

pipelines.py<br>

# Define your item pipelines here<br>#<br># Don't forget to add your pipeline to the ITEM_PIPELINES setting<br># See: https://docs.scrapy.org/en/latest/topics/item-pipeline.html<br><br><br># useful for handling different item types with a single interface<br>from itemadapter import ItemAdapter<br>import pymongo<br>from scrapy.exceptions import DropItem<br>from scrapy.pipelines.images import ImagesPipeline<br><br>class TubatuScrapyProjectPipeline:<br>    def __init__(self):<br>        myclient = pymongo.MongoClient("mongodb://106.12.9.193:27017", username="admin", password="123456")<br>        mydb = myclient['db_tubatu']<br>        self.mycollection = mydb['collection_tubatu']<br><br><br>    def process_item(self, item, spider):<br>        data = dict(item)<br>        self.mycollection.insert_one(data)<br>        return item<br><br># 自定义的图片下载类需要继承于ImagesPipeline<br>class TubatuImagePipeline(ImagesPipeline):<br>    # def get_media_requests(self, item, info):<br>    #     # 根据image_urls中指定URL爬取<br>    #     pass<br><br>    def item_completed(self, results, item, info):<br>        # 图片下载完毕之后，处理结果的，返回是一个二元组<br>        # (success, image_info_or_failure)<br>        image_paths = [x['path'] for ok, x in results if ok]<br>        if not image_paths:<br>            raise DropItem('Item contains no images')<br>        return item<br><br><br>    def file_path(self, request, response=None, info=None):<br>        url = request.url<br>        file_name = url.split('/')[-1]<br><br>        return file_name<br>

这是我pipelines文件的代码，运行以后存储到了数据库但是没有解析图片下载，也没有帮错

星光荡开宇宙 2021-09-03

源自：异步网络爬虫框架Scrapy 3-11 抓取并下载装修网站图片

收起

1回答

好帮手慕燕燕 2021-09-04 11:42:54

同学，你好！在settings.py中检查一下图片下载的pipeline是否启用，以及是否定义图片下载目录

祝：学习愉快！

收起回答

提问者星光荡开宇宙 #1

ITEM_PIPELINES = {
'tubatu_scrapy_project.pipelines.TubatuScrapyProjectPipeline': 300,
'tubatu_scrapy_project.pipelines.TubatuImagePipeline': 301,
}

# 定义好图片被下载到哪里
IMAGES_STORE = 'images'

我定义了

2021-09-04 12:27:02

好帮手慕燕燕回复提问者星光荡开宇宙 #2

同学，你好！可将整个项目打包发送到邮箱1757578369@qq.com，老师这边运行项目看一下。祝学习愉快！

2021-09-04 14:33:19
Cherub1Zhuang 回复好帮手慕燕燕 #3

老师我的也下载不了，也发给你了

2021-12-30 02:15:31