|
|
2019-05-04 00:09:47 [scrapy.utils.log] INFO: Scrapy 1.6.0 started (bot: bot)
|
|
|
2019-05-04 00:09:47 [scrapy.utils.log] INFO: Versions: lxml 4.3.3.0, libxml2 2.9.5, cssselect 1.0.3, parsel 1.5.1, w3lib 1.20.0, Twisted 18.9.0, Python 3.6.3 |Anaconda, Inc.| (default, Oct 15 2017, 03:27:45) [MSC v.1900 64 bit (AMD64)], pyOpenSSL 19.0.0 (OpenSSL 1.1.1b 26 Feb 2019), cryptography 2.6.1, Platform Windows-10-10.0.17763-SP0
|
|
|
2019-05-04 00:09:47 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'bot', 'DOWNLOAD_DELAY': 3, 'LOG_FILE': 'logs\\bot\\weibo_spider\\d920b69a6dbd11e99168b46d83b992e9.log', 'NEWSPIDER_MODULE': 'bot.spiders', 'SPIDER_MODULES': ['bot.spiders']}
|
|
|
2019-05-04 00:09:47 [scrapy.extensions.telnet] INFO: Telnet Password: 6ffc64c3615f13b7
|
|
|
2019-05-04 00:09:47 [scrapy.middleware] INFO: Enabled extensions:
|
|
|
['scrapy.extensions.corestats.CoreStats',
|
|
|
'scrapy.extensions.telnet.TelnetConsole',
|
|
|
'scrapy.extensions.logstats.LogStats']
|
|
|
2019-05-04 00:09:48 [scrapy.middleware] INFO: Enabled downloader middlewares:
|
|
|
['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
|
|
|
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
|
|
|
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
|
|
|
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
|
|
|
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
|
|
|
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
|
|
|
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
|
|
|
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
|
|
|
'scrapy.downloadermiddlewares.stats.DownloaderStats']
|
|
|
2019-05-04 00:09:48 [scrapy.middleware] INFO: Enabled spider middlewares:
|
|
|
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
|
|
|
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
|
|
|
'scrapy.spidermiddlewares.referer.RefererMiddleware',
|
|
|
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
|
|
|
'scrapy.spidermiddlewares.depth.DepthMiddleware']
|
|
|
2019-05-04 00:09:48 [scrapy.middleware] INFO: Enabled item pipelines:
|
|
|
['bot.pipelines.BotPipeline']
|
|
|
2019-05-04 00:09:48 [scrapy.core.engine] INFO: Spider opened
|
|
|
2019-05-04 00:09:48 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
|
|
|
2019-05-04 00:09:48 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
|
|
|
2019-05-04 00:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/info> (referer: None)
|
|
|
2019-05-04 00:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/u/5048725112> (referer: https://weibo.cn/5048725112/info)
|
|
|
2019-05-04 00:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/u/5048725112>
|
|
|
|
|
|
{'Image': 'http://tvax4.sinaimg.cn/crop.0.0.1080.1080.180/005vFW2cly8g2bs9bdzi7j30u00u0gqw.jpg',
|
|
|
'_id': '5048725112',
|
|
|
'brief_introduction': 'Fear kills growth.',
|
|
|
'constellation': '1998-07-21',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 49, 829220),
|
|
|
'fans_num': 460,
|
|
|
'follows_num': 200,
|
|
|
'gender': '女',
|
|
|
'labels': '美食,创意设计',
|
|
|
'nick_name': '娆娆娆娆娆娆娆娆娆',
|
|
|
'province': '天津',
|
|
|
'tweets_num': 277,
|
|
|
'vip_level': '1级'}
|
|
|
2019-05-04 00:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=1> (referer: https://weibo.cn/u/5048725112)
|
|
|
2019-05-04 00:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=1>
|
|
|
|
|
|
{'_id': '5048725112_Hsw3y5WUb',
|
|
|
'comment_num': 69,
|
|
|
'content': '位要链接的姐妹们,如果你们进主页的话看这里,要链接的太太太多了私信不过来了,在评论里发的链接也沉了,而且wb已经不让我私信了,不好意思不能都单独回啦因为旗舰店这家的裙子下架了…所以我就直接发截图啦,你们可以用识图看看别家还卖不卖',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 55, 878111),
|
|
|
'created_at': '2019-05-03 20:41',
|
|
|
'like_num': 66,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Hsw3y5WUb'}
|
|
|
2019-05-04 00:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=1>
|
|
|
|
|
|
{'_id': '5048725112_HrZ1PF9x2',
|
|
|
'comment_num': 4,
|
|
|
'content': '联4的这个片场,为什么给人一种工人们找包工头要钱的画面感',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 55, 898101),
|
|
|
'created_at': '2019-04-30 08:36',
|
|
|
'like_num': 13,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HrZ1PF9x2'}
|
|
|
2019-05-04 00:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=1>
|
|
|
|
|
|
{'_id': '5048725112_Hr8BJh6Ij',
|
|
|
'comment_num': 0,
|
|
|
'content': '看完电影:初代结束了,虽然有点难过,但我可以接受睡醒觉:不我不能',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 55, 904098),
|
|
|
'created_at': '2019-04-24 19:09',
|
|
|
'like_num': 8,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Hr8BJh6Ij'}
|
|
|
2019-05-04 00:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=1>
|
|
|
|
|
|
{'_id': '5048725112_HqPPao1fr',
|
|
|
'comment_num': 2,
|
|
|
'content': '间惨案',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 55, 912092),
|
|
|
'created_at': '2019-04-22 19:19',
|
|
|
'like_num': 10,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HqPPao1fr'}
|
|
|
2019-05-04 00:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=1>
|
|
|
|
|
|
{'_id': '5048725112_Hq5OS8S1g',
|
|
|
'comment_num': 3,
|
|
|
'content': '1℃[火焰] 天津·宜家家居IKEA',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 55, 918090),
|
|
|
'created_at': '2019-04-17 22:12',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Hq5OS8S1g'}
|
|
|
2019-05-04 00:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=1>
|
|
|
|
|
|
{'_id': '5048725112_HpC4ynG7J',
|
|
|
'comment_num': 0,
|
|
|
'content': '当爱豆加上港风滤镜# 港仔出gai,迷倒一片',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 55, 924084),
|
|
|
'created_at': '2019-04-14 18:29',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HpC4ynG7J'}
|
|
|
2019-05-04 00:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=1>
|
|
|
|
|
|
{'_id': '5048725112_HpkRAhzC8',
|
|
|
'comment_num': 0,
|
|
|
'content': ' Oxygen ] [蓝心].MV:王嘉尔 - Oxygen.#王嘉尔##Oxygen##4月12日# #TEAMWANG# '
|
|
|
'#新单曲# #我的你们#',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 55, 933093),
|
|
|
'created_at': '2019-04-12 22:40',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HpkRAhzC8'}
|
|
|
2019-05-04 00:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=1>
|
|
|
|
|
|
{'_id': '5048725112_HnY3N1tgG',
|
|
|
'comment_num': 9,
|
|
|
'content': '久没敢量过体重了[紧张]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 55, 939078),
|
|
|
'created_at': '2019-04-03 22:47',
|
|
|
'like_num': 8,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HnY3N1tgG'}
|
|
|
2019-05-04 00:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=1>
|
|
|
|
|
|
{'_id': '5048725112_HnOAIidNK',
|
|
|
'comment_num': 0,
|
|
|
'content': '遇[草莓]🍫',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 55, 946073),
|
|
|
'created_at': '2019-04-02 22:40',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HnOAIidNK'}
|
|
|
2019-05-04 00:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=1>
|
|
|
|
|
|
{'_id': '5048725112_HnbwNjz03',
|
|
|
'comment_num': 7,
|
|
|
'content': '[樱花] 日本·大阪城公园',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 9, 56, 7040),
|
|
|
'created_at': '2019-03-29 19:13',
|
|
|
'like_num': 9,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HnbwNjz03'}
|
|
|
2019-05-04 00:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=28> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=28>
|
|
|
|
|
|
{'_id': '5048725112_BhWoKc2mj',
|
|
|
'comment_num': 0,
|
|
|
'content': '只骨折的萌猫复诊,啊呀怎么那么萌!!!!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 0, 599376),
|
|
|
'created_at': '2014-08-12 15:05:32',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/BhWoKc2mj'}
|
|
|
2019-05-04 00:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=28>
|
|
|
|
|
|
{'_id': '5048725112_Bgixr1amo',
|
|
|
'comment_num': 0,
|
|
|
'content': 'Joey“和”Chandler“前一阵在一个节目上重聚,两人头发都白了。。眼眶瞬间.......时光十年,“老友记”一去不复返~~~',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 0, 621362),
|
|
|
'created_at': '2014-08-01 19:46:46',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Bgixr1amo'}
|
|
|
2019-05-04 00:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=28>
|
|
|
|
|
|
{'_id': '5048725112_BdWlqsLfD',
|
|
|
'comment_num': 0,
|
|
|
'content': '个夏天,我想和你一起去看海。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 0, 638353),
|
|
|
'created_at': '2014-07-17 07:36:08',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 1,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/BdWlqsLfD'}
|
|
|
2019-05-04 00:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=28>
|
|
|
|
|
|
{'_id': '5048725112_Bd6Bw5y3c',
|
|
|
'comment_num': 0,
|
|
|
'content': '定要和心爱的人,去希腊圣托里尼岛看一次爱琴海的日落。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 0, 658312),
|
|
|
'created_at': '2014-07-11 19:52:57',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Bd6Bw5y3c'}
|
|
|
2019-05-04 00:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=28>
|
|
|
|
|
|
{'_id': '5048725112_BaaRLer6d',
|
|
|
'comment_num': 0,
|
|
|
'content': '腊圣托里尼的早餐 在这我绝不赖床[花心]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 0, 673333),
|
|
|
'created_at': '2014-06-22 13:13:02',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/BaaRLer6d'}
|
|
|
2019-05-04 00:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=28>
|
|
|
|
|
|
{'_id': '5048725112_B7LqCBn81',
|
|
|
'comment_num': 0,
|
|
|
'content': '你们',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 0, 692322),
|
|
|
'created_at': '2014-06-06 16:46:55',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/B7LqCBn81'}
|
|
|
2019-05-04 00:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=28>
|
|
|
|
|
|
{'_id': '5048725112_B5Fk9rD8E',
|
|
|
'comment_num': 6,
|
|
|
'content': '',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 0, 704305),
|
|
|
'created_at': '2014-05-23 21:33:53',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/B5Fk9rD8E'}
|
|
|
2019-05-04 00:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=28>
|
|
|
|
|
|
{'_id': '5048725112_B4Bw37Ced',
|
|
|
'comment_num': 0,
|
|
|
'content': '牛轰轰漫画#那些年,我被姥姥带大',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 0, 717297),
|
|
|
'created_at': '2014-05-16 22:01:54',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/B4Bw37Ced'}
|
|
|
2019-05-04 00:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=28>
|
|
|
|
|
|
{'_id': '5048725112_AFHozEP7y',
|
|
|
'comment_num': 0,
|
|
|
'content': '懒人最适合的减肥教程】全面教你每个动作怎么练、练几遍,GIF动图上都已经标明了,你只要照做就可以了。不管是腹直肌、腹外斜肌,美腿、翘臀不在话下,一个不落都练得到。[花心]更多健身教程,关注@私人健身中心 '
|
|
|
'。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 0, 728290),
|
|
|
'created_at': '2014-04-14 22:16:54',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/AFHozEP7y'}
|
|
|
2019-05-04 00:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=27> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=27>
|
|
|
|
|
|
{'_id': '5048725112_C6zjHiidv',
|
|
|
'comment_num': 0,
|
|
|
'content': '狠理科生谈恋爱#这大概就是爱了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 4, 168648),
|
|
|
'created_at': '2015-03-01 18:50:52',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/C6zjHiidv'}
|
|
|
2019-05-04 00:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=27>
|
|
|
|
|
|
{'_id': '5048725112_BDrriwMnS',
|
|
|
'comment_num': 0,
|
|
|
'content': '015啦!大家新年快乐~每个人都对我很重要都要好好哒!Ps.今年就要高三了好激动呀🙈',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 4, 188636),
|
|
|
'created_at': '2015-01-01 00:43:22',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/BDrriwMnS'}
|
|
|
2019-05-04 00:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=27>
|
|
|
|
|
|
{'_id': '5048725112_Bxvf8cAA9',
|
|
|
'comment_num': 0,
|
|
|
'content': '5岁的那一页里,写下了最好的我们。#安妮和王小明# 第二季最终话',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 4, 206616),
|
|
|
'created_at': '2014-11-22 23:22:33',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Bxvf8cAA9'}
|
|
|
2019-05-04 00:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=27>
|
|
|
|
|
|
{'_id': '5048725112_Bw4ZL3MbO',
|
|
|
'comment_num': 0,
|
|
|
'content': '然只有和萌萌哒拍出来才会显得年轻嘛~',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 4, 217610),
|
|
|
'created_at': '2014-11-13 14:42:57',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Bw4ZL3MbO'}
|
|
|
2019-05-04 00:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=27>
|
|
|
|
|
|
{'_id': '5048725112_BvluMrTy3',
|
|
|
'comment_num': 0,
|
|
|
'content': '吴昕 天台见!保重!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 4, 228604),
|
|
|
'created_at': '2014-11-08 18:53:02',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/BvluMrTy3'}
|
|
|
2019-05-04 00:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=27>
|
|
|
|
|
|
{'_id': '5048725112_Btj28yIGB',
|
|
|
'comment_num': 0,
|
|
|
'content': '歉,此微博已被作者删除。查看帮助:http://t.cn/Rfd3rQV',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 4, 239586),
|
|
|
'created_at': '2014-10-26 08:56:22',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Btj28yIGB'}
|
|
|
2019-05-04 00:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=27>
|
|
|
|
|
|
{'_id': '5048725112_BqDo3niju',
|
|
|
'comment_num': 2,
|
|
|
'content': '然真的收到了好开心!!以为都收不到了呢',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 4, 247582),
|
|
|
'created_at': '2014-10-08 19:14:23',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/BqDo3niju'}
|
|
|
2019-05-04 00:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=27>
|
|
|
|
|
|
{'_id': '5048725112_BmI7tCCcQ',
|
|
|
'comment_num': 0,
|
|
|
'content': '哈马粉色沙滩',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 4, 255577),
|
|
|
'created_at': '2014-09-12 23:56:04',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/BmI7tCCcQ'}
|
|
|
2019-05-04 00:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=27>
|
|
|
|
|
|
{'_id': '5048725112_BlMuODB2v',
|
|
|
'comment_num': 0,
|
|
|
'content': '水时可模拟下雨的花盆,好有爱',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 4, 263572),
|
|
|
'created_at': '2014-09-06 21:14:15',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/BlMuODB2v'}
|
|
|
2019-05-04 00:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=27>
|
|
|
|
|
|
{'_id': '5048725112_BkyM32S8Y',
|
|
|
'comment_num': 0,
|
|
|
'content': '到安妮了!!活的安妮呢!!太开心!!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 4, 271568),
|
|
|
'created_at': '2014-08-29 20:27:56',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/BkyM32S8Y'}
|
|
|
2019-05-04 00:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=26> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=26>
|
|
|
|
|
|
{'_id': '5048725112_CvCClcSd6',
|
|
|
'comment_num': 0,
|
|
|
'content': '界上最帅的逆行',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 6, 742524),
|
|
|
'created_at': '2015-08-13 13:12:38',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 1,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CvCClcSd6'}
|
|
|
2019-05-04 00:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=26>
|
|
|
|
|
|
{'_id': '5048725112_Cvwyr8Igt',
|
|
|
'comment_num': 0,
|
|
|
'content': '上最温情婚礼:89岁的外婆,当了我的伴娘,莫名的心酸',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 6, 756498),
|
|
|
'created_at': '2015-08-12 21:46:33',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Cvwyr8Igt'}
|
|
|
2019-05-04 00:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=26>
|
|
|
|
|
|
{'_id': '5048725112_Cu973cKH3',
|
|
|
'comment_num': 0,
|
|
|
'content': '个寡言,但心有一片海的人。|ins:brooklynhawaii',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 6, 763494),
|
|
|
'created_at': '2015-08-03 20:15:36',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Cu973cKH3'}
|
|
|
2019-05-04 00:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=26>
|
|
|
|
|
|
{'_id': '5048725112_Ctf8wkT1L',
|
|
|
'comment_num': 2,
|
|
|
'content': '火辣打卡# 我在@火辣健身 完成了 7分钟打造女神马甲线 第7天:http://t.cn/RL9cxp2',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 6, 771506),
|
|
|
'created_at': '2015-07-28 21:45:24',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Ctf8wkT1L'}
|
|
|
2019-05-04 00:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=26>
|
|
|
|
|
|
{'_id': '5048725112_Cmp9ICp5X',
|
|
|
'comment_num': 0,
|
|
|
'content': '洞要的第三次,感觉要中毒了啊喂!#李易峰吴昕#',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 6, 779495),
|
|
|
'created_at': '2015-06-13 22:23:42',
|
|
|
'like_num': 21,
|
|
|
'repost_num': 1,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Cmp9ICp5X'}
|
|
|
2019-05-04 00:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=26>
|
|
|
|
|
|
{'_id': '5048725112_Cl8TKdhaZ',
|
|
|
'comment_num': 0,
|
|
|
'content': '大雄,如果我不在了,被胖虎和小夫欺负的话你能一个人对付他们吗”',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 6, 787484),
|
|
|
'created_at': '2015-06-05 15:10:05',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Cl8TKdhaZ'}
|
|
|
2019-05-04 00:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=26>
|
|
|
|
|
|
{'_id': '5048725112_CizZxbvgr',
|
|
|
'comment_num': 0,
|
|
|
'content': '友在台北东湖市场拍到的凉糕摊老板,又一个在菜市场摆摊的小伙走红了 via 台南阿呆仔',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 6, 801500),
|
|
|
'created_at': '2015-05-19 18:37:35',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CizZxbvgr'}
|
|
|
2019-05-04 00:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=26>
|
|
|
|
|
|
{'_id': '5048725112_Cdn0uvw5e',
|
|
|
'comment_num': 0,
|
|
|
'content': '心暖暖木哈哈哈68的土豪们不到2000钻啊',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 6, 814480),
|
|
|
'created_at': '2015-04-15 12:22:44',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Cdn0uvw5e'}
|
|
|
2019-05-04 00:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=26>
|
|
|
|
|
|
{'_id': '5048725112_CcPcywfFt',
|
|
|
'comment_num': 0,
|
|
|
'content': '迪尼斯乐园】1955年珍贵的经典老式彩色照片,年代感扑面而来。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 6, 826472),
|
|
|
'created_at': '2015-04-11 22:19:04',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CcPcywfFt'}
|
|
|
2019-05-04 00:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=26>
|
|
|
|
|
|
{'_id': '5048725112_C8F6BbX2D',
|
|
|
'comment_num': 4,
|
|
|
'content': '歉,作者已设置仅展示半年内微博,此微博已不可见。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 6, 836471),
|
|
|
'created_at': '2015-03-15 13:15:41',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/C8F6BbX2D'}
|
|
|
2019-05-04 00:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=25> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=25>
|
|
|
|
|
|
{'_id': '5048725112_CDXvZkSIG',
|
|
|
'comment_num': 0,
|
|
|
'content': '呦呦都魔性了怎么办,随手分享一个已经成为我粉丝的叶良辰',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 10, 593248),
|
|
|
'created_at': '2015-10-07 09:07:07',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CDXvZkSIG'}
|
|
|
2019-05-04 00:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=25>
|
|
|
|
|
|
{'_id': '5048725112_CDRZM7Bm8',
|
|
|
'comment_num': 0,
|
|
|
'content': '王龙这个梗真是让我笑到不行。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 10, 609238),
|
|
|
'created_at': '2015-10-06 19:04:01',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CDRZM7Bm8'}
|
|
|
2019-05-04 00:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=25>
|
|
|
|
|
|
{'_id': '5048725112_CDFUW8kTy',
|
|
|
'comment_num': 4,
|
|
|
'content': '统趁我看视频没注意悄悄更新到了9,现在只想把手机扔出去',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 10, 625229),
|
|
|
'created_at': '2015-10-05 12:19:08',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CDFUW8kTy'}
|
|
|
2019-05-04 00:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=25>
|
|
|
|
|
|
{'_id': '5048725112_CDmaM64hu',
|
|
|
'comment_num': 2,
|
|
|
'content': '果糖猪一号 快看快看小老太婆过的可好啦天天枸杞大杏仁,白菜汤表示不服',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 10, 637211),
|
|
|
'created_at': '2015-10-03 10:03:13',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CDmaM64hu'}
|
|
|
2019-05-04 00:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=25>
|
|
|
|
|
|
{'_id': '5048725112_CC3hAxPC0',
|
|
|
'comment_num': 24,
|
|
|
'content': '到啦!据说这个签名是精分出来哒!超开心特别特别看看么么哒',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 10, 649204),
|
|
|
'created_at': '2015-09-24 20:07:31',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CC3hAxPC0'}
|
|
|
2019-05-04 00:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=25>
|
|
|
|
|
|
{'_id': '5048725112_CAxlooRmg',
|
|
|
'comment_num': 0,
|
|
|
'content': '与千寻的原型———台北九份山城。从阿妹茶楼下的石阶往上爬,天黑之前到展望台看夕阳,再星空……太浪漫了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 10, 661178),
|
|
|
'created_at': '2015-09-14 20:58:40',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CAxlooRmg'}
|
|
|
2019-05-04 00:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=25>
|
|
|
|
|
|
{'_id': '5048725112_CAxlb68Dt',
|
|
|
'comment_num': 0,
|
|
|
'content': '享图片',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 10, 670193),
|
|
|
'created_at': '2015-09-14 20:58:09',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CAxlb68Dt'}
|
|
|
2019-05-04 00:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=25>
|
|
|
|
|
|
{'_id': '5048725112_Cz5XuxiN8',
|
|
|
'comment_num': 0,
|
|
|
'content': '宜家逛一圈莫名发现kimi 同款小黄🙈但我的是大黄',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 10, 681186),
|
|
|
'created_at': '2015-09-05 09:25:20',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Cz5XuxiN8'}
|
|
|
2019-05-04 00:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=25>
|
|
|
|
|
|
{'_id': '5048725112_CyRkLrC17',
|
|
|
'comment_num': 0,
|
|
|
'content': 'GIF图大杀流量】整个强迫症都治好了嗷嗷嗷嗷嗷嗷嗷嗷嗷嗷嗷嗷嗷嗷嗷嗷!!!!!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 10, 692160),
|
|
|
'created_at': '2015-09-03 20:11:28',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CyRkLrC17'}
|
|
|
2019-05-04 00:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=25>
|
|
|
|
|
|
{'_id': '5048725112_CvEGXkWVS',
|
|
|
'comment_num': 0,
|
|
|
'content': '爱你,如果能活着回来……',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 10, 700166),
|
|
|
'created_at': '2015-08-13 18:29:31',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CvEGXkWVS'}
|
|
|
2019-05-04 00:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=24> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=24>
|
|
|
|
|
|
{'_id': '5048725112_Dadum27J0',
|
|
|
'comment_num': 13,
|
|
|
'content': 'erry Christmas',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 14, 540459),
|
|
|
'created_at': '2015-12-26 17:22:12',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Dadum27J0'}
|
|
|
2019-05-04 00:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=24>
|
|
|
|
|
|
{'_id': '5048725112_D7NxuhHzj',
|
|
|
'comment_num': 0,
|
|
|
'content': '看图说不出话#“任何人都可以变得狠毒,只要你尝试过什么叫嫉妒。”——邮政小哥·家卫 #娱乐猛回头#',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 14, 562447),
|
|
|
'created_at': '2015-12-10 19:37:54',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/D7NxuhHzj'}
|
|
|
2019-05-04 00:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=24>
|
|
|
|
|
|
{'_id': '5048725112_D6ZFNuybb',
|
|
|
'comment_num': 0,
|
|
|
'content': '大家分享一些非常有用的生活小窍门',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 14, 578430),
|
|
|
'created_at': '2015-12-05 12:41:02',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/D6ZFNuybb'}
|
|
|
2019-05-04 00:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=24>
|
|
|
|
|
|
{'_id': '5048725112_D5P4L3fU6',
|
|
|
'comment_num': 0,
|
|
|
'content': '杰伦在金曲奖上一段超叼的钢琴Show,反应力满分,全程被我伦的呆萌帅翻了!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 14, 594425),
|
|
|
'created_at': '2015-11-27 19:52:01',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/D5P4L3fU6'}
|
|
|
2019-05-04 00:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=24>
|
|
|
|
|
|
{'_id': '5048725112_D4j88zOQy',
|
|
|
'comment_num': 0,
|
|
|
'content': '终于中奖啦!!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 14, 608434),
|
|
|
'created_at': '2015-11-17 20:42:09',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/D4j88zOQy'}
|
|
|
2019-05-04 00:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=24>
|
|
|
|
|
|
{'_id': '5048725112_D4iOlFu6L',
|
|
|
'comment_num': 0,
|
|
|
'content': 'ondon St Pancras 伦敦火车站今年的迪士尼毛绒玩具圣诞树[圣诞树][圣诞树]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 14, 620411),
|
|
|
'created_at': '2015-11-17 19:53:24',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/D4iOlFu6L'}
|
|
|
2019-05-04 00:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=24>
|
|
|
|
|
|
{'_id': '5048725112_D0NqDyv7e',
|
|
|
'comment_num': 0,
|
|
|
'content': '子某个展会上有人用三组乐高还原了大黄鸭遇害的全过程,我仿佛看到了人性中最黑暗的一面',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 14, 634399),
|
|
|
'created_at': '2015-10-25 18:28:55',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/D0NqDyv7e'}
|
|
|
2019-05-04 00:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=24>
|
|
|
|
|
|
{'_id': '5048725112_D0cjmBBYB',
|
|
|
'comment_num': 1,
|
|
|
'content': 'f(x)将回归 27日发行正规4辑《4Walls》',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 14, 648411),
|
|
|
'created_at': '2015-10-21 19:59:22',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/D0cjmBBYB'}
|
|
|
2019-05-04 00:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=24>
|
|
|
|
|
|
{'_id': '5048725112_CF5JO5XN9',
|
|
|
'comment_num': 0,
|
|
|
'content': '宠物店看到一只忧国忧民的柴柴,一看就知道是只正经汪。。。柴柴:“每天都要被自己帅醒,爱买不买!”',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 14, 661404),
|
|
|
'created_at': '2015-10-14 19:53:25',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CF5JO5XN9'}
|
|
|
2019-05-04 00:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=24>
|
|
|
|
|
|
{'_id': '5048725112_CEMFZtW90',
|
|
|
'comment_num': 0,
|
|
|
'content': '哈哈哈终于到啦~竟然有签名好开心!!!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 14, 672375),
|
|
|
'created_at': '2015-10-12 19:21:51',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/CEMFZtW90'}
|
|
|
2019-05-04 00:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=23> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=23>
|
|
|
|
|
|
{'_id': '5048725112_DiJA7BtoI',
|
|
|
'comment_num': 0,
|
|
|
'content': '吴琼琼的彩妆教室# '
|
|
|
'终于整理好我所用过的所有彩妆品的使用心得(下)之眼妆篇和腮红修容篇,每个都有试色,真实感受,有好有坏细心码字,希望大家多多支持',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 18, 582423),
|
|
|
'created_at': '2016-02-20 17:46:46',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DiJA7BtoI'}
|
|
|
2019-05-04 00:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=23>
|
|
|
|
|
|
{'_id': '5048725112_DixAXf6Rk',
|
|
|
'comment_num': 0,
|
|
|
'content': '师傅#辣味英雄传2#玩具人总动员正在上演!这是一部神奇的辣剧——3位玩具男主@陈赫 @孙艺洲 @李佳航MVP '
|
|
|
'为了争夺侍寝的权利,展开了激烈的斗争!BUT万万没想到,胡小菲@娄艺潇 最后选择的竟然是TA→_→速度戳:Forbidden '
|
|
|
'小牛只能剧透到这儿了! 康师傅辣味英雄传第二季 全面升级',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 18, 595416),
|
|
|
'created_at': '2016-02-19 11:15:50',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DixAXf6Rk'}
|
|
|
2019-05-04 00:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=23>
|
|
|
|
|
|
{'_id': '5048725112_DigaypHWk',
|
|
|
'comment_num': 0,
|
|
|
'content': '我美我先说#空气感的编发教程,适用于染色且有卷度的头发~',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 18, 603411),
|
|
|
'created_at': '2016-02-17 14:54:07',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DigaypHWk'}
|
|
|
2019-05-04 00:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=23>
|
|
|
|
|
|
{'_id': '5048725112_DieBMrHde',
|
|
|
'comment_num': 8,
|
|
|
'content': '起去日本目黑川看樱花吧!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 18, 609408),
|
|
|
'created_at': '2016-02-17 10:55:43',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DieBMrHde'}
|
|
|
2019-05-04 00:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=23>
|
|
|
|
|
|
{'_id': '5048725112_DgJX11cBA',
|
|
|
'comment_num': 0,
|
|
|
'content': '年快乐猴有福',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 18, 616404),
|
|
|
'created_at': '2016-02-07 15:02:33',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DgJX11cBA'}
|
|
|
2019-05-04 00:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=23>
|
|
|
|
|
|
{'_id': '5048725112_DfH5G7XD3',
|
|
|
'comment_num': 14,
|
|
|
'content': '外流行的一种“水族箱”美甲~长见识了!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 18, 622410),
|
|
|
'created_at': '2016-01-31 17:55:21',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DfH5G7XD3'}
|
|
|
2019-05-04 00:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=23>
|
|
|
|
|
|
{'_id': '5048725112_DdSbIDPMT',
|
|
|
'comment_num': 2,
|
|
|
'content': '国一家中国料理餐馆的棉花糖炸酱面......大家感受一下',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 18, 633395),
|
|
|
'created_at': '2016-01-19 18:29:51',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DdSbIDPMT'}
|
|
|
2019-05-04 00:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=23>
|
|
|
|
|
|
{'_id': '5048725112_DdwOuqr4t',
|
|
|
'comment_num': 0,
|
|
|
'content': '歉,作者已设置仅展示半年内微博,此微博已不可见。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 18, 640393),
|
|
|
'created_at': '2016-01-17 12:04:56',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DdwOuqr4t'}
|
|
|
2019-05-04 00:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=23>
|
|
|
|
|
|
{'_id': '5048725112_Db4OA5KCW',
|
|
|
'comment_num': 0,
|
|
|
'content': '歉,此微博已被作者删除。查看帮助:http://t.cn/Rfd3rQV',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 18, 646389),
|
|
|
'created_at': '2016-01-01 09:07:37',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Db4OA5KCW'}
|
|
|
2019-05-04 00:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=23>
|
|
|
|
|
|
{'_id': '5048725112_DaQ6bnszo',
|
|
|
'comment_num': 0,
|
|
|
'content': '学差的人,应该都是很单纯的人,因为他们想的没那么深,根本打败不了充满心机的数学。。。(转)',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 18, 653385),
|
|
|
'created_at': '2015-12-30 19:39:48',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DaQ6bnszo'}
|
|
|
2019-05-04 00:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=22> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=22>
|
|
|
|
|
|
{'_id': '5048725112_DvZQc2FZQ',
|
|
|
'comment_num': 4,
|
|
|
'content': '所憧憬的爱情是:搂着睡到自然醒,洗漱完胡乱塞几口零食,下午就窝在沙发看部电影,你说男主好帅,我说女主有爱。傍晚了系上围裙炒两个小菜,一张桌子、两副碗筷,你边吃边给我讲过去的糗事,说着说着就先笑了。有你的一天,虚度光阴都那么美好。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 21, 149235),
|
|
|
'created_at': '2016-05-17 23:04:14',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DvZQc2FZQ'}
|
|
|
2019-05-04 00:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=22>
|
|
|
|
|
|
{'_id': '5048725112_DvvElue9h',
|
|
|
'comment_num': 0,
|
|
|
'content': '歉,作者已设置仅展示半年内微博,此微博已不可见。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 21, 170242),
|
|
|
'created_at': '2016-05-14 18:12:40',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DvvElue9h'}
|
|
|
2019-05-04 00:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=22>
|
|
|
|
|
|
{'_id': '5048725112_DtDHj2RAF',
|
|
|
'comment_num': 0,
|
|
|
'content': '友截取了太阳的后裔中近70个宋仲基的笑容,这个boy的笑容有毒!cr.LF_swinLee '
|
|
|
'http://t.cn/RqjYsNo',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 21, 182214),
|
|
|
'created_at': '2016-05-02 11:01:19',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DtDHj2RAF'}
|
|
|
2019-05-04 00:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=22>
|
|
|
|
|
|
{'_id': '5048725112_DtnKErboP',
|
|
|
'comment_num': 0,
|
|
|
'content': '发妹纸必看——国外流行的几个扎马尾的方法。。赶紧get~#扎头发很简单#',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 21, 192213),
|
|
|
'created_at': '2016-04-30 18:25:36',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DtnKErboP'}
|
|
|
2019-05-04 00:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=22>
|
|
|
|
|
|
{'_id': '5048725112_DqXEOCmLe',
|
|
|
'comment_num': 0,
|
|
|
'content': '虐完男生虐女生!今晚《太阳的后裔》大结局',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 21, 204222),
|
|
|
'created_at': '2016-04-14 20:19:13',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DqXEOCmLe'}
|
|
|
2019-05-04 00:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=22>
|
|
|
|
|
|
{'_id': '5048725112_DpJV4pDZ9',
|
|
|
'comment_num': 0,
|
|
|
'content': '2015爆笑喜剧《希特勒回来了》】2011年夏天,希特勒醒来了,置身不再熟悉的柏林街头。亲信不在身边,帝国总理府不见踪迹,土耳其人满街跑,波兰依旧存在,德国女总理当家,希特勒原先认识的世界彻底改变。全程高能,各种桥段让人笑疯。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 21, 216215),
|
|
|
'created_at': '2016-04-06 19:30:30',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DpJV4pDZ9'}
|
|
|
2019-05-04 00:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=22>
|
|
|
|
|
|
{'_id': '5048725112_DnM8Wfi1e',
|
|
|
'comment_num': 0,
|
|
|
'content': '年流行的丸子头 两根扎头绳,一分钟搞定!get√(半丸子头并不适合每个人,所以,还是丸子头吧) 秒拍视频',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 21, 225203),
|
|
|
'created_at': '2016-03-24 21:29:33',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DnM8Wfi1e'}
|
|
|
2019-05-04 00:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=22>
|
|
|
|
|
|
{'_id': '5048725112_DmELZ6xdC',
|
|
|
'comment_num': 0,
|
|
|
'content': '不要以为你有钱长的帅 人生就能一帆风顺没有遗憾宋仲基今年31岁 至今没有我电话',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 21, 239185),
|
|
|
'created_at': '2016-03-17 12:53:29',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DmELZ6xdC'}
|
|
|
2019-05-04 00:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=22>
|
|
|
|
|
|
{'_id': '5048725112_DjvyXgB4E',
|
|
|
'comment_num': 0,
|
|
|
'content': '超实用】天气暖和了,雪地靴肯定是穿不上咯,你是不是只是简单的清洗后就收起来了?还是来看看雪地靴的保养小妙招吧,让旧鞋子也焕然一新呢!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 21, 250196),
|
|
|
'created_at': '2016-02-25 19:55:44',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DjvyXgB4E'}
|
|
|
2019-05-04 00:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=22>
|
|
|
|
|
|
{'_id': '5048725112_DiSIuoqEo',
|
|
|
'comment_num': 0,
|
|
|
'content': '吃在成都# 【你吃火锅必点的菜是啥?】「火锅里放什么食材会让我们惊为天人,泪流满面?」 '
|
|
|
'居然没有鹅肠、鸭血、兔er腰、脑花er、腐皮、折耳根、金针菇、油条、还有各种肉肉肉......我去吃火锅了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 21, 261189),
|
|
|
'created_at': '2016-02-21 17:02:06',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DiSIuoqEo'}
|
|
|
2019-05-04 00:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=21> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=21>
|
|
|
|
|
|
{'_id': '5048725112_EhHkTxGqz',
|
|
|
'comment_num': 0,
|
|
|
'content': '奕迅偷偷来看周杰伦演唱会被发现,周杰伦是这么回应的...http://t.cn/Rfv8L2D',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 25, 304414),
|
|
|
'created_at': '2016-11-15 20:57:45',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EhHkTxGqz'}
|
|
|
2019-05-04 00:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=21>
|
|
|
|
|
|
{'_id': '5048725112_EhogSywuE',
|
|
|
'comment_num': 2,
|
|
|
'content': '买一大批书,求推荐',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 25, 319405),
|
|
|
'created_at': '2016-11-13 20:25:39',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EhogSywuE'}
|
|
|
2019-05-04 00:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=21>
|
|
|
|
|
|
{'_id': '5048725112_EhkGgmqEY',
|
|
|
'comment_num': 2,
|
|
|
'content': '很多人从我的生活里离开了,无声无息的,一点一点的,他们都是曾经对我很好很好的人。我对很多事很后悔,但都没有重来的机会了。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 25, 326400),
|
|
|
'created_at': '2016-11-13 11:17:13',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EhkGgmqEY'}
|
|
|
2019-05-04 00:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=21>
|
|
|
|
|
|
{'_id': '5048725112_EfJ65FL8F',
|
|
|
'comment_num': 0,
|
|
|
'content': '室友啊!!我说要五个气球不给就绝交,结果这友情惊天地泣鬼神啊[飞吻]@亲室友 么么么么么么么么么么么么么么',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 25, 339393),
|
|
|
'created_at': '2016-11-02 21:46:09',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EfJ65FL8F'}
|
|
|
2019-05-04 00:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=21>
|
|
|
|
|
|
{'_id': '5048725112_EcXXgwH4f',
|
|
|
'comment_num': 0,
|
|
|
'content': '着这个图我能笑一整天!你能再笨一些吗?#熊本加油# #熊本熊表情包# #呆萌一派# #搞笑表情动图# #熊本熊表情包# '
|
|
|
'#潜行者计划#',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 25, 347389),
|
|
|
'created_at': '2016-10-15 18:04:43',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EcXXgwH4f'}
|
|
|
2019-05-04 00:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=21>
|
|
|
|
|
|
{'_id': '5048725112_E8J9bAr10',
|
|
|
'comment_num': 0,
|
|
|
'content': '白啦乔任梁',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 25, 357381),
|
|
|
'created_at': '2016-09-17 21:01:40',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/E8J9bAr10'}
|
|
|
2019-05-04 00:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=21>
|
|
|
|
|
|
{'_id': '5048725112_E1cylAbWJ',
|
|
|
'comment_num': 0,
|
|
|
'content': '适自己发型的女生的颜值都很高,然选择适合自己的发型才是好发型',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 25, 364379),
|
|
|
'created_at': '2016-07-30 09:10:54',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/E1cylAbWJ'}
|
|
|
2019-05-04 00:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=21>
|
|
|
|
|
|
{'_id': '5048725112_DAQW1ptuH',
|
|
|
'comment_num': 0,
|
|
|
'content': '新手必看的正确的化妆顺序】包括护肤&化妆&卸妆顺序详解,一个帖子全搞定~从现在开始不再做化妆小白[胜利]️',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 25, 371374),
|
|
|
'created_at': '2016-06-18 21:35:25',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 1,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DAQW1ptuH'}
|
|
|
2019-05-04 00:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=21>
|
|
|
|
|
|
{'_id': '5048725112_DztNAoU2j',
|
|
|
'comment_num': 0,
|
|
|
'content': '阳的后裔全部歌曲,十首音乐ost合集连听,每一首都实力好听。视频较长,先码再看',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 25, 381369),
|
|
|
'created_at': '2016-06-09 20:51:09',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DztNAoU2j'}
|
|
|
2019-05-04 00:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=21>
|
|
|
|
|
|
{'_id': '5048725112_DxaGoreTD',
|
|
|
'comment_num': 0,
|
|
|
'content': '文学翻译家杨绛病逝# '
|
|
|
'据澎湃新闻消息,著名女作家、文学翻译家和外国文学研究家、钱钟书夫人杨绛于5月25日凌晨在北京协和医院病逝,享年105岁。杨绛,本名杨季康,江苏无锡人,通晓英语法语西班牙语,由她翻译的《唐•吉诃德》被公认为最优秀的翻译佳作。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 25, 389365),
|
|
|
'created_at': '2016-05-25 16:30:37',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/DxaGoreTD'}
|
|
|
2019-05-04 00:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=20> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=20>
|
|
|
|
|
|
{'_id': '5048725112_EsMAweE8f',
|
|
|
'comment_num': 0,
|
|
|
'content': '望鸡年是特别好的一年[爱心]️~新春快乐呦[气球]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 27, 774014),
|
|
|
'created_at': '2017-01-27 18:33:19',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EsMAweE8f'}
|
|
|
2019-05-04 00:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=20>
|
|
|
|
|
|
{'_id': '5048725112_EryM5ycB9',
|
|
|
'comment_num': 4,
|
|
|
'content': '个长久的对视…最后耗子忍不住先动了嘴咬了熊的鼻子🌚现在留熊寄几一脸懵',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 27, 791991),
|
|
|
'created_at': '2017-01-19 17:33:04',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EryM5ycB9'}
|
|
|
2019-05-04 00:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=20>
|
|
|
|
|
|
{'_id': '5048725112_Eq8cbsP3K',
|
|
|
'comment_num': 0,
|
|
|
'content': '紫棋《我是歌手》第二季表演集锦,印象最深的就是前三首歌《泡沫》《存在》《你把我灌醉》,后来翻唱的《龙卷风》《喜欢你》也是堪称经典,“铁肺小天后”的名号真的是名不虚传,小小的身躯里可以迸发出如此庞大的力量实属难得。不知道这一季的我歌会让哪位歌手大放异彩',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 27, 804985),
|
|
|
'created_at': '2017-01-10 08:02:51',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Eq8cbsP3K'}
|
|
|
2019-05-04 00:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=20>
|
|
|
|
|
|
{'_id': '5048725112_Epilt8xdM',
|
|
|
'comment_num': 1,
|
|
|
'content': '阴阳师手游# 我获得了全新特典皮肤,随手分享还愿,传递欧气~٩( °༥° )و!!姑姑!!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 27, 818006),
|
|
|
'created_at': '2017-01-04 20:02:55',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Epilt8xdM'}
|
|
|
2019-05-04 00:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=20>
|
|
|
|
|
|
{'_id': '5048725112_EoIvi88AM',
|
|
|
'comment_num': 0,
|
|
|
'content': '017年希望每个人都可以不劳而获靠脸吃饭腿长逆天少吃狗粮表白成功考试不挂土豪成精少吸雾霾瘦成闪电 [飞吻]最最重要的是继续幸福! '
|
|
|
'[爱心]新年快乐啦~',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 27, 829982),
|
|
|
'created_at': '2017-01-01 00:48:14',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EoIvi88AM'}
|
|
|
2019-05-04 00:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=20>
|
|
|
|
|
|
{'_id': '5048725112_EokKpATcJ',
|
|
|
'comment_num': 0,
|
|
|
'content': '被陈乔恩这句话触到:别人的看法,真的不用在意。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 27, 840963),
|
|
|
'created_at': '2016-12-29 12:19:33',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EokKpATcJ'}
|
|
|
2019-05-04 00:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=20>
|
|
|
|
|
|
{'_id': '5048725112_EnDhnFE1e',
|
|
|
'comment_num': 0,
|
|
|
'content': 'erry Christmas~/爱心 你们都会拥有最好的幸福/玫瑰 今天是无所畏惧的红配绿[眼泪]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 27, 853955),
|
|
|
'created_at': '2016-12-24 21:39:56',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EnDhnFE1e'}
|
|
|
2019-05-04 00:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=20>
|
|
|
|
|
|
{'_id': '5048725112_EmoaOjn8E',
|
|
|
'comment_num': 3,
|
|
|
'content': '十二收货啦😐',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 27, 866951),
|
|
|
'created_at': '2016-12-16 17:22:14',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EmoaOjn8E'}
|
|
|
2019-05-04 00:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=20>
|
|
|
|
|
|
{'_id': '5048725112_Em3EaiHf4',
|
|
|
'comment_num': 3,
|
|
|
'content': '的事真正面对时,才发现它不像你想得那么糟糕',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 27, 877944),
|
|
|
'created_at': '2016-12-14 13:06:52',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Em3EaiHf4'}
|
|
|
2019-05-04 00:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=20>
|
|
|
|
|
|
{'_id': '5048725112_Ejks6CqHt',
|
|
|
'comment_num': 0,
|
|
|
'content': '现时光相册最大的特点就是不管你照什么都给你一片天🌝',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 27, 890937),
|
|
|
'created_at': '2016-11-26 14:22:57',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Ejks6CqHt'}
|
|
|
2019-05-04 00:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=19> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=19>
|
|
|
|
|
|
{'_id': '5048725112_ECVa3tkR4',
|
|
|
'comment_num': 0,
|
|
|
'content': '棚 照相',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 29, 962176),
|
|
|
'created_at': '2017-04-04 10:45:53',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/ECVa3tkR4'}
|
|
|
2019-05-04 00:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=19>
|
|
|
|
|
|
{'_id': '5048725112_ECUVa4CIj',
|
|
|
'comment_num': 0,
|
|
|
'content': '5天虐腹计划~!每个动作1分钟,春天要到了,更不能偷懒哟![江南style]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 29, 983136),
|
|
|
'created_at': '2017-04-04 10:09:11',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/ECUVa4CIj'}
|
|
|
2019-05-04 00:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=19>
|
|
|
|
|
|
{'_id': '5048725112_ECPKKrulx',
|
|
|
'comment_num': 0,
|
|
|
'content': '开心的事无非就是挑完喜欢的照片刚好九张~天气好棒 人也好多🤢 天津 · 河西区',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 29, 998155),
|
|
|
'created_at': '2017-04-03 20:59:48',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/ECPKKrulx'}
|
|
|
2019-05-04 00:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=19>
|
|
|
|
|
|
{'_id': '5048725112_ECEqo5COU',
|
|
|
'comment_num': 0,
|
|
|
'content': 'KEA新款—大黄的好朋友二哈',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 30, 75082),
|
|
|
'created_at': '2017-04-02 16:09:25',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/ECEqo5COU'}
|
|
|
2019-05-04 00:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=19>
|
|
|
|
|
|
{'_id': '5048725112_ECoa15bCb',
|
|
|
'comment_num': 0,
|
|
|
'content': '本的一位麻麻,经常给宝宝cos成各种可爱角色去迪斯尼玩,而且不少服装都是自己手工做的。各种形态下的娃真是太激萌了,可爱到翻滚!(ins:tiahy__)',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 30, 92080),
|
|
|
'created_at': '2017-03-31 22:45:08',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/ECoa15bCb'}
|
|
|
2019-05-04 00:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=19>
|
|
|
|
|
|
{'_id': '5048725112_EAQeUve9S',
|
|
|
'comment_num': 0,
|
|
|
'content': '可能是我听过最真实毫无做作的《痒》了,好刺激',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 30, 111061),
|
|
|
'created_at': '2017-03-21 18:33:30',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EAQeUve9S'}
|
|
|
2019-05-04 00:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=19>
|
|
|
|
|
|
{'_id': '5048725112_EAf3jvE20',
|
|
|
'comment_num': 0,
|
|
|
'content': '得少女心爆棚,就是要看童话嘛',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 30, 128050),
|
|
|
'created_at': '2017-03-17 19:53:18',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EAf3jvE20'}
|
|
|
2019-05-04 00:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=19>
|
|
|
|
|
|
{'_id': '5048725112_ExUUVnivW',
|
|
|
'comment_num': 0,
|
|
|
'content': '误吃了巧克力怎么办?笑死宝宝了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 30, 142044),
|
|
|
'created_at': '2017-03-02 12:57:05',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/ExUUVnivW'}
|
|
|
2019-05-04 00:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=19>
|
|
|
|
|
|
{'_id': '5048725112_ExbNMfyrq',
|
|
|
'comment_num': 0,
|
|
|
'content': '这天气应该是个假天津哦',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 30, 156047),
|
|
|
'created_at': '2017-02-25 18:05:52',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/ExbNMfyrq'}
|
|
|
2019-05-04 00:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=19>
|
|
|
|
|
|
{'_id': '5048725112_Evo9qD1Sr',
|
|
|
'comment_num': 0,
|
|
|
'content': '好呀老上海',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 30, 165040),
|
|
|
'created_at': '2017-02-13 21:51:34',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Evo9qD1Sr'}
|
|
|
2019-05-04 00:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=18> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=18>
|
|
|
|
|
|
{'_id': '5048725112_F8ANiyf5q',
|
|
|
'comment_num': 0,
|
|
|
'content': '宝被没收玩具气的打滚, 一只国宝被奶妈没收了玩具,气的直打滚!果然是名副其实的功夫熊猫,满地打滚的样子太萌了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 33, 624343),
|
|
|
'created_at': '2017-06-19 22:30:04',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/F8ANiyf5q'}
|
|
|
2019-05-04 00:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=18>
|
|
|
|
|
|
{'_id': '5048725112_F8hF4pcis',
|
|
|
'comment_num': 0,
|
|
|
'content': '以桐携手Marie Digby翻唱的《Galway Girl》开口跪!好好听哇',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 33, 642336),
|
|
|
'created_at': '2017-06-17 21:47:35',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/F8hF4pcis'}
|
|
|
2019-05-04 00:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=18>
|
|
|
|
|
|
{'_id': '5048725112_F7X76ad7v',
|
|
|
'comment_num': 0,
|
|
|
'content': '完之后明白,一定要和智障保持距离,不然会被传染的...',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 33, 651328),
|
|
|
'created_at': '2017-06-15 17:28:59',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/F7X76ad7v'}
|
|
|
2019-05-04 00:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=18>
|
|
|
|
|
|
{'_id': '5048725112_F4W5wuZhi',
|
|
|
'comment_num': 0,
|
|
|
'content': '谢世界上一直有这些可爱的人们',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 33, 660325),
|
|
|
'created_at': '2017-05-26 21:21:26',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/F4W5wuZhi'}
|
|
|
2019-05-04 00:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=18>
|
|
|
|
|
|
{'_id': '5048725112_F2YlXATgR',
|
|
|
'comment_num': 0,
|
|
|
'content': 'oodnight',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 33, 670318),
|
|
|
'created_at': '2017-05-13 23:26:49',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/F2YlXATgR'}
|
|
|
2019-05-04 00:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=18>
|
|
|
|
|
|
{'_id': '5048725112_F2SXmAq28',
|
|
|
'comment_num': 0,
|
|
|
'content': '28天后一起见证马甲线】 4个动作,对应各处腹肌,结合锻炼,练到所有腹部肌肉。 '
|
|
|
'次数视频里都有说明,卧槽,碉堡了,妹子们先马再看!!!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 33, 678314),
|
|
|
'created_at': '2017-05-13 09:42:28',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/F2SXmAq28'}
|
|
|
2019-05-04 00:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=18>
|
|
|
|
|
|
{'_id': '5048725112_EFoucfwtS',
|
|
|
'comment_num': 0,
|
|
|
'content': '儿子',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 33, 688318),
|
|
|
'created_at': '2017-04-20 17:05:46',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EFoucfwtS'}
|
|
|
2019-05-04 00:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=18>
|
|
|
|
|
|
{'_id': '5048725112_EF4y7cTy1',
|
|
|
'comment_num': 9,
|
|
|
'content': '无话不说到无话可说 天津 · 大学城',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 33, 700308),
|
|
|
'created_at': '2017-04-18 14:20:29',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EF4y7cTy1'}
|
|
|
2019-05-04 00:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=18>
|
|
|
|
|
|
{'_id': '5048725112_EE2ivaVVW',
|
|
|
'comment_num': 0,
|
|
|
'content': '国九大风情小镇(冷门篇),推荐给你的旅行目的地,转需收藏备用,假期用得着。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 33, 708314),
|
|
|
'created_at': '2017-04-11 18:46:13',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/EE2ivaVVW'}
|
|
|
2019-05-04 00:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=18>
|
|
|
|
|
|
{'_id': '5048725112_ED7XQ34dw',
|
|
|
'comment_num': 3,
|
|
|
'content': '的看见手腕散发着绿光 wow还以为我变异了🌝懵了好久才想起来是打排球打青的 上图 自从学了ps ,p图技术日趋惊奇 '
|
|
|
'忍不住给自己一个肯定的眼神😗 天津 · 大学城',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 33, 723302),
|
|
|
'created_at': '2017-04-05 19:21:29',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/ED7XQ34dw'}
|
|
|
2019-05-04 00:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=17> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=17>
|
|
|
|
|
|
{'_id': '5048725112_FdH0mwKQa',
|
|
|
'comment_num': 0,
|
|
|
'content': '歉,作者已设置仅展示半年内微博,此微博已不可见。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 37, 592434),
|
|
|
'created_at': '2017-07-23 11:30:15',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FdH0mwKQa'}
|
|
|
2019-05-04 00:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=17>
|
|
|
|
|
|
{'_id': '5048725112_FdkcX8auB',
|
|
|
'comment_num': 0,
|
|
|
'content': '你生日快乐',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 37, 608414),
|
|
|
'created_at': '2017-07-21 01:28:05',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FdkcX8auB'}
|
|
|
2019-05-04 00:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=17>
|
|
|
|
|
|
{'_id': '5048725112_FcZWCcXBY',
|
|
|
'comment_num': 0,
|
|
|
'content': '喜欢深夜食堂这种淡淡的人情,看完觉得很平淡生活就是这样。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 37, 615410),
|
|
|
'created_at': '2017-07-18 21:52:54',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FcZWCcXBY'}
|
|
|
2019-05-04 00:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=17>
|
|
|
|
|
|
{'_id': '5048725112_FbtVSslL9',
|
|
|
'comment_num': 0,
|
|
|
'content': '辈子有机会一定要去一次的城市,马住!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 37, 624409),
|
|
|
'created_at': '2017-07-08 22:32:53',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FbtVSslL9'}
|
|
|
2019-05-04 00:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=17>
|
|
|
|
|
|
{'_id': '5048725112_Fb1u7pb6z',
|
|
|
'comment_num': 0,
|
|
|
'content': '会后悔没有好好说再见,再见要用力一点 一期一会 天津·天津滨海国际机场',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 37, 633413),
|
|
|
'created_at': '2017-07-05 22:07:34',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Fb1u7pb6z'}
|
|
|
2019-05-04 00:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=17>
|
|
|
|
|
|
{'_id': '5048725112_FaVHhxGc2',
|
|
|
'comment_num': 0,
|
|
|
'content': '宋仲基宋慧乔结婚# '
|
|
|
'据韩媒报道,主演《太阳的后裔》男女主角宋仲基和宋慧乔发布婚讯,两人预计在10月31日完婚。两人透过经纪公司表示,结婚并非两人的事,必须是要和家族会面等慎重的情况。两人先前多次传出热恋,但都被否认,而这一次直接公布婚讯。宋仲基宋慧乔曾多次否认恋情',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 37, 639405),
|
|
|
'created_at': '2017-07-05 07:23:32',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FaVHhxGc2'}
|
|
|
2019-05-04 00:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=17>
|
|
|
|
|
|
{'_id': '5048725112_FaV9I68nG',
|
|
|
'comment_num': 0,
|
|
|
'content': '人的生活一点也不棒棒,最棒的还是自己的',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 37, 648402),
|
|
|
'created_at': '2017-07-05 06:00:49',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FaV9I68nG'}
|
|
|
2019-05-04 00:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=17>
|
|
|
|
|
|
{'_id': '5048725112_F9OhXhnfS',
|
|
|
'comment_num': 0,
|
|
|
'content': '技改变生活,这是传说中的人工智障吧!简直丧心病狂!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 37, 654387),
|
|
|
'created_at': '2017-06-27 22:41:36',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/F9OhXhnfS'}
|
|
|
2019-05-04 00:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=17>
|
|
|
|
|
|
{'_id': '5048725112_F97PXeCYZ',
|
|
|
'comment_num': 0,
|
|
|
'content': '火壁纸四张。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 37, 664382),
|
|
|
'created_at': '2017-06-23 10:37:16',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/F97PXeCYZ'}
|
|
|
2019-05-04 00:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=17>
|
|
|
|
|
|
{'_id': '5048725112_F8ASIfxWK',
|
|
|
'comment_num': 0,
|
|
|
'content': '最最喜欢美人鱼啦',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 37, 670390),
|
|
|
'created_at': '2017-06-19 22:43:24',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/F8ASIfxWK'}
|
|
|
2019-05-04 00:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=16> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=16>
|
|
|
|
|
|
{'_id': '5048725112_FlXPVyqIm',
|
|
|
'comment_num': 0,
|
|
|
'content': '自私的人呆在一起久了害怕自己也变成自私的人',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 41, 113644),
|
|
|
'created_at': '2017-09-15 21:03:40',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FlXPVyqIm'}
|
|
|
2019-05-04 00:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=16>
|
|
|
|
|
|
{'_id': '5048725112_FlWl9tnPf',
|
|
|
'comment_num': 8,
|
|
|
'content': '骗想发自拍惹',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 41, 127637),
|
|
|
'created_at': '2017-09-15 17:15:06',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FlWl9tnPf'}
|
|
|
2019-05-04 00:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=16>
|
|
|
|
|
|
{'_id': '5048725112_Fl43e3mLZ',
|
|
|
'comment_num': 5,
|
|
|
'content': '平[向右]南开[向右]河北[向右]虹桥[向右]和平 比我步数还多的我猜应该是走出国了😧',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 41, 134646),
|
|
|
'created_at': '2017-09-09 23:02:36',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Fl43e3mLZ'}
|
|
|
2019-05-04 00:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=16>
|
|
|
|
|
|
{'_id': '5048725112_Fk90Bzl7G',
|
|
|
'comment_num': 0,
|
|
|
'content': '大天津',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 41, 143629),
|
|
|
'created_at': '2017-09-03 21:49:35',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Fk90Bzl7G'}
|
|
|
2019-05-04 00:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=16>
|
|
|
|
|
|
{'_id': '5048725112_Fia0ijrBC',
|
|
|
'comment_num': 0,
|
|
|
'content': '海迪士尼全景,美得不可思议,有空去的时候可以拿这个当地图了,马走!全景图片',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 41, 151636),
|
|
|
'created_at': '2017-08-21 20:40:57',
|
|
|
'like_num': 0,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Fia0ijrBC'}
|
|
|
2019-05-04 00:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=16>
|
|
|
|
|
|
{'_id': '5048725112_FgusL50bn',
|
|
|
'comment_num': 0,
|
|
|
'content': '果有傻逼跑过来骂你',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 41, 158619),
|
|
|
'created_at': '2017-08-10 21:05:24',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FgusL50bn'}
|
|
|
2019-05-04 00:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=16>
|
|
|
|
|
|
{'_id': '5048725112_Fgk4XljpG',
|
|
|
'comment_num': 0,
|
|
|
'content': 'AC十二支经典口红色号,少一支都不行!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 41, 166627),
|
|
|
'created_at': '2017-08-09 18:39:17',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Fgk4XljpG'}
|
|
|
2019-05-04 00:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=16>
|
|
|
|
|
|
{'_id': '5048725112_FfTgn3JUP',
|
|
|
'comment_num': 0,
|
|
|
'content': '年第20本书打卡 叮[瑜伽二]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 41, 175610),
|
|
|
'created_at': '2017-08-06 22:23:15',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FfTgn3JUP'}
|
|
|
2019-05-04 00:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=16>
|
|
|
|
|
|
{'_id': '5048725112_FeWsk3qq8',
|
|
|
'comment_num': 0,
|
|
|
'content': '你做各式各样的面包,赶紧马克!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 41, 182607),
|
|
|
'created_at': '2017-07-31 16:40:38',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 1,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FeWsk3qq8'}
|
|
|
2019-05-04 00:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=16>
|
|
|
|
|
|
{'_id': '5048725112_FeLjUeGQc',
|
|
|
'comment_num': 0,
|
|
|
'content': '津',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 41, 192601),
|
|
|
'created_at': '2017-07-30 12:19:41',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FeLjUeGQc'}
|
|
|
2019-05-04 00:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=15> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=15>
|
|
|
|
|
|
{'_id': '5048725112_FvxSWvnSU',
|
|
|
'comment_num': 0,
|
|
|
'content': '了这首歌的毒[爱心]️',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 45, 122333),
|
|
|
'created_at': '2017-11-17 21:22:43',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FvxSWvnSU'}
|
|
|
2019-05-04 00:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=15>
|
|
|
|
|
|
{'_id': '5048725112_FvwrLyXIL',
|
|
|
'comment_num': 0,
|
|
|
'content': '十一最可爱[彩虹]是我们俩[气球] 天津·天津医科大学',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 45, 134309),
|
|
|
'created_at': '2017-11-17 17:43:01',
|
|
|
'like_num': 6,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FvwrLyXIL'}
|
|
|
2019-05-04 00:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=15>
|
|
|
|
|
|
{'_id': '5048725112_FvnRk6F9h',
|
|
|
'comment_num': 6,
|
|
|
'content': '太小面膜太大',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 45, 142305),
|
|
|
'created_at': '2017-11-16 19:51:15',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FvnRk6F9h'}
|
|
|
2019-05-04 00:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=15>
|
|
|
|
|
|
{'_id': '5048725112_Fv1nJzmu7',
|
|
|
'comment_num': 0,
|
|
|
'content': '歉,此微博已被作者删除。查看帮助:http://t.cn/Rfd3rQV',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 45, 150301),
|
|
|
'created_at': '2017-11-14 10:37:56',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Fv1nJzmu7'}
|
|
|
2019-05-04 00:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=15>
|
|
|
|
|
|
{'_id': '5048725112_FuBCv5dmc',
|
|
|
'comment_num': 6,
|
|
|
'content': '天也像晴天[彩虹] 天津·天津医科大学',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 45, 158295),
|
|
|
'created_at': '2017-11-11 17:02:52',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FuBCv5dmc'}
|
|
|
2019-05-04 00:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=15>
|
|
|
|
|
|
{'_id': '5048725112_FuyHEhR50',
|
|
|
'comment_num': 2,
|
|
|
'content': '纪轻轻就一脸穷酸相',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 45, 167290),
|
|
|
'created_at': '2017-11-11 09:37:20',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FuyHEhR50'}
|
|
|
2019-05-04 00:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=15>
|
|
|
|
|
|
{'_id': '5048725112_FrrxOeCvv',
|
|
|
'comment_num': 0,
|
|
|
'content': '只正在洗澡的小猫咪,这只猫是实心的,第一次看到洗澡不缩水的猫',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 45, 172287),
|
|
|
'created_at': '2017-10-21 21:52:56',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FrrxOeCvv'}
|
|
|
2019-05-04 00:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=15>
|
|
|
|
|
|
{'_id': '5048725112_FpBWN04yf',
|
|
|
'comment_num': 4,
|
|
|
'content': '其自然就好了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 45, 180285),
|
|
|
'created_at': '2017-10-09 20:41:21',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FpBWN04yf'}
|
|
|
2019-05-04 00:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=15>
|
|
|
|
|
|
{'_id': '5048725112_Fp9J1xobu',
|
|
|
'comment_num': 10,
|
|
|
'content': '华九十岁生日快乐[礼花]💕 天津·耀华中学',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 45, 186292),
|
|
|
'created_at': '2017-10-06 20:50:32',
|
|
|
'like_num': 8,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Fp9J1xobu'}
|
|
|
2019-05-04 00:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=15>
|
|
|
|
|
|
{'_id': '5048725112_FmJ9Ok3Ub',
|
|
|
'comment_num': 6,
|
|
|
'content': '胖轩拍了一下午的成果,我们总结出以下两条拍好照片的经验1.换摄像师2.换模特最后一张为什么要挡住脸呢?因为我喜欢我飘逸的头发,但是脸太丑了实在p不出来了🙃重要的图发三遍',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 45, 194288),
|
|
|
'created_at': '2017-09-20 21:31:45',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FmJ9Ok3Ub'}
|
|
|
2019-05-04 00:10:48 [scrapy.extensions.logstats] INFO: Crawled 17 pages (at 17 pages/min), scraped 150 items (at 150 items/min)
|
|
|
2019-05-04 00:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=14> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=14>
|
|
|
|
|
|
{'_id': '5048725112_FAygqj2ka',
|
|
|
'comment_num': 0,
|
|
|
'content': '轻轨]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 49, 311500),
|
|
|
'created_at': '2017-12-20 19:32:05',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FAygqj2ka'}
|
|
|
2019-05-04 00:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=14>
|
|
|
|
|
|
{'_id': '5048725112_FAn8woSIt',
|
|
|
'comment_num': 0,
|
|
|
'content': '见很好看的情头存下来 等着有男朋友了用 希望用的时候它还没长毛',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 49, 331508),
|
|
|
'created_at': '2017-12-19 15:12:24',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FAn8woSIt'}
|
|
|
2019-05-04 00:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=14>
|
|
|
|
|
|
{'_id': '5048725112_FA38Gv0hQ',
|
|
|
'comment_num': 3,
|
|
|
'content': '心里最温暖的味道了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 49, 343501),
|
|
|
'created_at': '2017-12-17 12:17:52',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FA38Gv0hQ'}
|
|
|
2019-05-04 00:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=14>
|
|
|
|
|
|
{'_id': '5048725112_Fz1NetR9q',
|
|
|
'comment_num': 0,
|
|
|
'content': '情也是彩虹味的~下次要学做这个[彩虹]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 49, 358475),
|
|
|
'created_at': '2017-12-10 19:01:58',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Fz1NetR9q'}
|
|
|
2019-05-04 00:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=14>
|
|
|
|
|
|
{'_id': '5048725112_FyRWh4vkS',
|
|
|
'comment_num': 0,
|
|
|
'content': '但是超好吃的小蛋糕[彩虹]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 49, 370474),
|
|
|
'created_at': '2017-12-09 17:56:46',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FyRWh4vkS'}
|
|
|
2019-05-04 00:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=14>
|
|
|
|
|
|
{'_id': '5048725112_FyPbTw8Mj',
|
|
|
'comment_num': 0,
|
|
|
'content': '天都会和自己说一遍',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 49, 387456),
|
|
|
'created_at': '2017-12-09 10:57:01',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FyPbTw8Mj'}
|
|
|
2019-05-04 00:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=14>
|
|
|
|
|
|
{'_id': '5048725112_FydqKuqgX',
|
|
|
'comment_num': 5,
|
|
|
'content': 'api酱的周一放送——如果具有12星座典型性格的12个人,凑在一起开会,会是什么样的呢?(这是我精分最多的一期视频了,好累!(周一愉快啦(你是什么星座的?papi酱的秒拍视频',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 49, 400452),
|
|
|
'created_at': '2017-12-05 10:49:14',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FydqKuqgX'}
|
|
|
2019-05-04 00:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=14>
|
|
|
|
|
|
{'_id': '5048725112_Fxw3D2aJH',
|
|
|
'comment_num': 7,
|
|
|
'content': '次难过的时候都能找到几个你知道无论如何都会支持你的朋友真好',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 49, 414461),
|
|
|
'created_at': '2017-11-30 20:24:09',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Fxw3D2aJH'}
|
|
|
2019-05-04 00:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=14>
|
|
|
|
|
|
{'_id': '5048725112_FwKyFe8ru',
|
|
|
'comment_num': 2,
|
|
|
'content': '听minute 5心情就超棒 想跳舞[卡门]🏼',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 49, 427453),
|
|
|
'created_at': '2017-11-25 19:28:45',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FwKyFe8ru'}
|
|
|
2019-05-04 00:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=14>
|
|
|
|
|
|
{'_id': '5048725112_FvEnTax7h',
|
|
|
'comment_num': 2,
|
|
|
'content': '多事情 '
|
|
|
'因为自己是朋友的身份,就想尽我的能力去帮助。后来我发现很多人遇到事都是自私的,只会为了自己,就算是你以为的约定,在这些面前也什么都不算。这样做也许没有什么对错,只是我不喜欢这样。也只有在我面对发生的事时,回头才会发现其实身后空无一人。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 49, 439434),
|
|
|
'created_at': '2017-11-18 13:55:26',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FvEnTax7h'}
|
|
|
2019-05-04 00:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=13> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=13>
|
|
|
|
|
|
{'_id': '5048725112_FFAh5qHqw',
|
|
|
'comment_num': 0,
|
|
|
'content': '棒的日子[椰树] 泰国·斯米兰国家公园',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 51, 863324),
|
|
|
'created_at': '2018-01-22 21:50:44',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FFAh5qHqw'}
|
|
|
2019-05-04 00:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=13>
|
|
|
|
|
|
{'_id': '5048725112_FFrqEkahp',
|
|
|
'comment_num': 0,
|
|
|
'content': '鱼][裙子]🏖️',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 51, 881314),
|
|
|
'created_at': '2018-01-21 23:19:34',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FFrqEkahp'}
|
|
|
2019-05-04 00:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=13>
|
|
|
|
|
|
{'_id': '5048725112_FEUJ962PD',
|
|
|
'comment_num': 0,
|
|
|
'content': 'runa否认与陈伟霆恋情,听说陈伟霆帅的不可开交,哪有时间谈恋爱',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 51, 892313),
|
|
|
'created_at': '2018-01-18 12:04:29',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FEUJ962PD'}
|
|
|
2019-05-04 00:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=13>
|
|
|
|
|
|
{'_id': '5048725112_FEhOxpnUp',
|
|
|
'comment_num': 0,
|
|
|
'content': '歉,作者已设置仅展示半年内微博,此微博已不可见。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 51, 898304),
|
|
|
'created_at': '2018-01-14 09:00:39',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FEhOxpnUp'}
|
|
|
2019-05-04 00:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=13>
|
|
|
|
|
|
{'_id': '5048725112_FE3VB7Zyv',
|
|
|
'comment_num': 3,
|
|
|
'content': '歉,作者已设置仅展示半年内微博,此微博已不可见。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 51, 906300),
|
|
|
'created_at': '2018-01-12 21:39:35',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FE3VB7Zyv'}
|
|
|
2019-05-04 00:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=13>
|
|
|
|
|
|
{'_id': '5048725112_FDVG4fKYR',
|
|
|
'comment_num': 1,
|
|
|
'content': '然两本书真的背不下来了但是心情还是说不出的不错~',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 51, 912296),
|
|
|
'created_at': '2018-01-12 00:39:21',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FDVG4fKYR'}
|
|
|
2019-05-04 00:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=13>
|
|
|
|
|
|
{'_id': '5048725112_FCjrgaO4k',
|
|
|
'comment_num': 0,
|
|
|
'content': '谢所有相遇,新年快乐[爱心]️ 2018不说别的了,就祝大家一夜暴富吧',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 51, 918292),
|
|
|
'created_at': '2018-01-01 09:28:11',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FCjrgaO4k'}
|
|
|
2019-05-04 00:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=13>
|
|
|
|
|
|
{'_id': '5048725112_FBUqNB5iB',
|
|
|
'comment_num': 9,
|
|
|
'content': '呦喂',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 51, 927287),
|
|
|
'created_at': '2017-12-29 17:48:23',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FBUqNB5iB'}
|
|
|
2019-05-04 00:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=13>
|
|
|
|
|
|
{'_id': '5048725112_FBaDjCcje',
|
|
|
'comment_num': 0,
|
|
|
'content': '安夜咯[圣诞树]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 51, 933284),
|
|
|
'created_at': '2017-12-24 21:12:52',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FBaDjCcje'}
|
|
|
2019-05-04 00:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=13>
|
|
|
|
|
|
{'_id': '5048725112_FAH9EE0SP',
|
|
|
'comment_num': 0,
|
|
|
'content': '昊然\xa0新书《见风》内页写真 | 单眼皮,白衬衫,初恋脸,正是青春里少年模样的代表',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 51, 940281),
|
|
|
'created_at': '2017-12-21 18:10:08',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/FAH9EE0SP'}
|
|
|
2019-05-04 00:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=12> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=12>
|
|
|
|
|
|
{'_id': '5048725112_G4hV3alsc',
|
|
|
'comment_num': 5,
|
|
|
'content': '我的意思了吧 四罐汽水的秒拍视频',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 55, 710950),
|
|
|
'created_at': '2018-02-22 13:50:03',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G4hV3alsc'}
|
|
|
2019-05-04 00:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=12>
|
|
|
|
|
|
{'_id': '5048725112_G44IVj2r5',
|
|
|
'comment_num': 3,
|
|
|
'content': '歉,此微博已被作者删除。查看帮助:http://t.cn/Rfd3rQV',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 55, 716960),
|
|
|
'created_at': '2018-02-21 04:14:28',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G44IVj2r5'}
|
|
|
2019-05-04 00:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=12>
|
|
|
|
|
|
{'_id': '5048725112_G3QgjhEpN',
|
|
|
'comment_num': 0,
|
|
|
'content': '半小时梳个头发[emoji]🏻♀️再花一个小时自拍🤳',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 55, 726955),
|
|
|
'created_at': '2018-02-19 15:25:31',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G3QgjhEpN'}
|
|
|
2019-05-04 00:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=12>
|
|
|
|
|
|
{'_id': '5048725112_G3OeGoaYQ',
|
|
|
'comment_num': 0,
|
|
|
'content': '歉,作者已设置仅展示半年内微博,此微博已不可见。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 55, 731941),
|
|
|
'created_at': '2018-02-19 10:16:01',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G3OeGoaYQ'}
|
|
|
2019-05-04 00:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=12>
|
|
|
|
|
|
{'_id': '5048725112_G3I2BBzhV',
|
|
|
'comment_num': 0,
|
|
|
'content': '望你每天醒来都是阳光的不会因为别人的几句话几个表情和几个举止就影响自己的心情好好生活 总会遇见美好的事',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 55, 741935),
|
|
|
'created_at': '2018-02-18 18:29:47',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G3I2BBzhV'}
|
|
|
2019-05-04 00:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=12>
|
|
|
|
|
|
{'_id': '5048725112_G3fAp3OB1',
|
|
|
'comment_num': 0,
|
|
|
'content': '夕就是一家人在一起 一起做饭一起吃饭一起聊以前的事就是最最简单又真实的幸福啦💕',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 55, 748928),
|
|
|
'created_at': '2018-02-15 18:03:22',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G3fAp3OB1'}
|
|
|
2019-05-04 00:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=12>
|
|
|
|
|
|
{'_id': '5048725112_G36fXvCp7',
|
|
|
'comment_num': 2,
|
|
|
'content': '知道往浴缸里加了什么,混在一起都是草莓味哒',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 55, 754927),
|
|
|
'created_at': '2018-02-14 18:18:18',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G36fXvCp7'}
|
|
|
2019-05-04 00:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=12>
|
|
|
|
|
|
{'_id': '5048725112_G2EnZ1RVn',
|
|
|
'comment_num': 0,
|
|
|
'content': '刘昊然女友标准大揭秘】我有一个新年愿望,希望能在大学期间能谈一次恋爱。刘昊然:我理想中的女朋友:“长头发、大眼睛、不会很闹腾的女孩”,不太相信一见钟情,但第一次见是会有好感的吧,然后再慢慢发展。昊然弟弟的迷妹们,你们准备好和TA谈恋爱了么',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 55, 762924),
|
|
|
'created_at': '2018-02-11 19:21:09',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G2EnZ1RVn'}
|
|
|
2019-05-04 00:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=12>
|
|
|
|
|
|
{'_id': '5048725112_G0F781DJa',
|
|
|
'comment_num': 0,
|
|
|
'content': '不好诊所',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 55, 768917),
|
|
|
'created_at': '2018-01-29 17:31:46',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G0F781DJa'}
|
|
|
2019-05-04 00:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=12>
|
|
|
|
|
|
{'_id': '5048725112_G000ee3kI',
|
|
|
'comment_num': 0,
|
|
|
'content': '也是个开过快艇在海上漂移的女人了🏝 泰国·波达岛',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 55, 775913),
|
|
|
'created_at': '2018-01-25 08:52:09',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G000ee3kI'}
|
|
|
2019-05-04 00:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=11> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=11>
|
|
|
|
|
|
{'_id': '5048725112_G9YeOfcMG',
|
|
|
'comment_num': 0,
|
|
|
'content': '猫咪][樱花] 天津·猫太之花式料理',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 58, 788496),
|
|
|
'created_at': '2018-03-31 22:45:37',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G9YeOfcMG'}
|
|
|
2019-05-04 00:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=11>
|
|
|
|
|
|
{'_id': '5048725112_G8AZBjzzc',
|
|
|
'comment_num': 0,
|
|
|
'content': 'o problem',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 58, 801489),
|
|
|
'created_at': '2018-03-22 21:44:40',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G8AZBjzzc'}
|
|
|
2019-05-04 00:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=11>
|
|
|
|
|
|
{'_id': '5048725112_G8jet6W1t',
|
|
|
'comment_num': 0,
|
|
|
'content': '享单曲Delicate(@网易云音乐)single cycle',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 58, 809484),
|
|
|
'created_at': '2018-03-21 00:31:51',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G8jet6W1t'}
|
|
|
2019-05-04 00:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=11>
|
|
|
|
|
|
{'_id': '5048725112_G6Cecjfpd',
|
|
|
'comment_num': 2,
|
|
|
'content': '忍住吃了几块炸鸡,天天吃沙拉的规律生活一回家就破功',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 58, 818479),
|
|
|
'created_at': '2018-03-09 21:12:46',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G6Cecjfpd'}
|
|
|
2019-05-04 00:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=11>
|
|
|
|
|
|
{'_id': '5048725112_G5DBFEbpf',
|
|
|
'comment_num': 0,
|
|
|
'content': '歉,作者已设置仅展示半年内微博,此微博已不可见。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 58, 824476),
|
|
|
'created_at': '2018-03-03 10:53:04',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G5DBFEbpf'}
|
|
|
2019-05-04 00:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=11>
|
|
|
|
|
|
{'_id': '5048725112_G5wzkxWAZ',
|
|
|
'comment_num': 2,
|
|
|
'content': '但愿遇见你的那天我洗了头化了妆 穿了你喜欢的衣服是你爱的样子"',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 58, 834473),
|
|
|
'created_at': '2018-03-02 16:58:03',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G5wzkxWAZ'}
|
|
|
2019-05-04 00:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=11>
|
|
|
|
|
|
{'_id': '5048725112_G5mPOAZRb',
|
|
|
'comment_num': 3,
|
|
|
'content': '终于练出来隐隐约约的肱二头肌和马甲线嘿嘿嘿嘿嘿嘿嘿嘿嘿嘿',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 58, 842478),
|
|
|
'created_at': '2018-03-01 16:11:12',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G5mPOAZRb'}
|
|
|
2019-05-04 00:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=11>
|
|
|
|
|
|
{'_id': '5048725112_G5mAnyPAf',
|
|
|
'comment_num': 3,
|
|
|
'content': '智如我,怕是要孤独终老了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 58, 851461),
|
|
|
'created_at': '2018-03-01 15:33:10',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G5mAnyPAf'}
|
|
|
2019-05-04 00:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=11>
|
|
|
|
|
|
{'_id': '5048725112_G59N5cqob',
|
|
|
'comment_num': 5,
|
|
|
'content': '久不见',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 58, 858466),
|
|
|
'created_at': '2018-02-28 06:58:45',
|
|
|
'like_num': 6,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G59N5cqob'}
|
|
|
2019-05-04 00:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=11>
|
|
|
|
|
|
{'_id': '5048725112_G4lZFqwjO',
|
|
|
'comment_num': 0,
|
|
|
'content': '风用没剩几年的压岁钱买套乐高两天不吃不喝专心盖房子[家]超喜欢趴在垃圾桶旁边的耗子 想让它进厨房吃火鸡[看看]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 10, 58, 864453),
|
|
|
'created_at': '2018-02-23 00:12:25',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/G4lZFqwjO'}
|
|
|
2019-05-04 00:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=10> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=10>
|
|
|
|
|
|
{'_id': '5048725112_GeXZqCzWU',
|
|
|
'comment_num': 4,
|
|
|
'content': '近每天都会被不同的美色迷得一愣一愣的',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 2, 749973),
|
|
|
'created_at': '2018-05-03 19:19:15',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GeXZqCzWU'}
|
|
|
2019-05-04 00:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=10>
|
|
|
|
|
|
{'_id': '5048725112_GeAi4rsQ2',
|
|
|
'comment_num': 0,
|
|
|
'content': '了两天感觉自己变成了个海鲜[海浪] 青岛 · 黄岛区',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 2, 791947),
|
|
|
'created_at': '2018-05-01 06:59:15',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GeAi4rsQ2'}
|
|
|
2019-05-04 00:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=10>
|
|
|
|
|
|
{'_id': '5048725112_GdBkgbQhp',
|
|
|
'comment_num': 0,
|
|
|
'content': '实生活就是这样的 你抱着混日子的心态 那它也会糊弄你 但如果你抱着认真的姿态 那它就会认真糊弄你了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 2, 804948),
|
|
|
'created_at': '2018-04-24 19:47:05',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GdBkgbQhp'}
|
|
|
2019-05-04 00:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=10>
|
|
|
|
|
|
{'_id': '5048725112_GcVgLDcUt',
|
|
|
'comment_num': 0,
|
|
|
'content': '能电梯 ,惊现老外满级中文,哈哈哈这个能笑一年',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 2, 816938),
|
|
|
'created_at': '2018-04-20 08:43:07',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GcVgLDcUt'}
|
|
|
2019-05-04 00:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=10>
|
|
|
|
|
|
{'_id': '5048725112_GcQPe2n2w',
|
|
|
'comment_num': 0,
|
|
|
'content': '疼起来真要命 想一头扎进冰水里',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 2, 834926),
|
|
|
'created_at': '2018-04-19 21:24:15',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GcQPe2n2w'}
|
|
|
2019-05-04 00:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=10>
|
|
|
|
|
|
{'_id': '5048725112_GcoTC8Ruh',
|
|
|
'comment_num': 7,
|
|
|
'content': '生前19年靠着语感混过中考高考四级六级,从来不知道语法是什么,现在决心重新开始,遇到的第一个瓶颈:谓语是什么??',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 2, 841918),
|
|
|
'created_at': '2018-04-16 22:18:10',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GcoTC8Ruh'}
|
|
|
2019-05-04 00:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=10>
|
|
|
|
|
|
{'_id': '5048725112_GbXlFxMSj',
|
|
|
'comment_num': 2,
|
|
|
'content': '定什么的 好难呀[白云]️',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 2, 850915),
|
|
|
'created_at': '2018-04-14 00:10:23',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GbXlFxMSj'}
|
|
|
2019-05-04 00:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=10>
|
|
|
|
|
|
{'_id': '5048725112_GaQYRBWpD',
|
|
|
'comment_num': 0,
|
|
|
'content': '·滤镜',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 2, 860907),
|
|
|
'created_at': '2018-04-06 18:07:25',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GaQYRBWpD'}
|
|
|
2019-05-04 00:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=10>
|
|
|
|
|
|
{'_id': '5048725112_Ganm4fd0O',
|
|
|
'comment_num': 0,
|
|
|
'content': 't is a truth universally acknowledged, that a single man in '
|
|
|
'possession of a good fortune,must be in want of a wife. 天津·天津工业大学',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 2, 867903),
|
|
|
'created_at': '2018-04-03 14:42:10',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Ganm4fd0O'}
|
|
|
2019-05-04 00:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=10>
|
|
|
|
|
|
{'_id': '5048725112_Ga4nqeFfL',
|
|
|
'comment_num': 2,
|
|
|
'content': '月不减肥,五月六月七月八月九月徒伤悲[加油] 天津·天津医科大学',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 2, 875899),
|
|
|
'created_at': '2018-04-01 14:23:19',
|
|
|
'like_num': 6,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Ga4nqeFfL'}
|
|
|
2019-05-04 00:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=9> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=9>
|
|
|
|
|
|
{'_id': '5048725112_GmYVukzAA',
|
|
|
'comment_num': 0,
|
|
|
'content': '是祖母绿墨水~这次兑进去很多金粉。动态的时候会有类似银河流动的视觉效果,干了之后再拍照就是另外的颜色了。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 5, 944546),
|
|
|
'created_at': '2018-06-25 12:24:44',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GmYVukzAA'}
|
|
|
2019-05-04 00:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=9>
|
|
|
|
|
|
{'_id': '5048725112_GmJnxzwMh',
|
|
|
'comment_num': 0,
|
|
|
'content': '富饶的深夜厨房# 今天厨房里回荡着我哇哇喊 太惨了太惨了 的声音第一次杀生啊',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 5, 956535),
|
|
|
'created_at': '2018-06-23 20:49:54',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GmJnxzwMh'}
|
|
|
2019-05-04 00:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=9>
|
|
|
|
|
|
{'_id': '5048725112_GmqW7dUHI',
|
|
|
'comment_num': 0,
|
|
|
'content': '了~',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 5, 962529),
|
|
|
'created_at': '2018-06-21 21:52:52',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GmqW7dUHI'}
|
|
|
2019-05-04 00:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=9>
|
|
|
|
|
|
{'_id': '5048725112_GlWOF9acZ',
|
|
|
'comment_num': 3,
|
|
|
'content': '富饶的深夜厨房# 今天是被北方代表嫌弃的咸肉粽子[幽灵]江米放多少全凭手感,肉是多大块全靠命运粽子节快乐🌿',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 5, 970516),
|
|
|
'created_at': '2018-06-18 17:12:06',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GlWOF9acZ'}
|
|
|
2019-05-04 00:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=9>
|
|
|
|
|
|
{'_id': '5048725112_GlOXRBZOb',
|
|
|
'comment_num': 0,
|
|
|
'content': '富饶的深夜厨房# 给自己做个话题督促自己以后好好做菜',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 5, 979509),
|
|
|
'created_at': '2018-06-17 21:12:48',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GlOXRBZOb'}
|
|
|
2019-05-04 00:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=9>
|
|
|
|
|
|
{'_id': '5048725112_GlCqUcZuS',
|
|
|
'comment_num': 2,
|
|
|
'content': '进客厅就看到这样的场景她眼里的是…渴望?',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 5, 990505),
|
|
|
'created_at': '2018-06-16 13:18:38',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GlCqUcZuS'}
|
|
|
2019-05-04 00:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=9>
|
|
|
|
|
|
{'_id': '5048725112_Gktz0Evty',
|
|
|
'comment_num': 5,
|
|
|
'content': '天的我真的幸福感爆棚[星光]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 5, 998505),
|
|
|
'created_at': '2018-06-09 00:53:35',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Gktz0Evty'}
|
|
|
2019-05-04 00:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=9>
|
|
|
|
|
|
{'_id': '5048725112_Gju12fcPJ',
|
|
|
'comment_num': 0,
|
|
|
'content': '日份的正能量',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 6, 18489),
|
|
|
'created_at': '2018-06-02 12:12:19',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Gju12fcPJ'}
|
|
|
2019-05-04 00:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=9>
|
|
|
|
|
|
{'_id': '5048725112_GgNAipw8M',
|
|
|
'comment_num': 10,
|
|
|
'content': '赞不负有心人系列啊哈哈哈哈哈@撒钱少女',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 6, 27500),
|
|
|
'created_at': '2018-05-15 20:30:28',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GgNAipw8M'}
|
|
|
2019-05-04 00:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=9>
|
|
|
|
|
|
{'_id': '5048725112_GgtCCmEwF',
|
|
|
'comment_num': 2,
|
|
|
'content': '博最近真是不能瞎逛,逛一逛,谁死了就知道了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 6, 35494),
|
|
|
'created_at': '2018-05-13 17:41:15',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GgtCCmEwF'}
|
|
|
2019-05-04 00:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=8> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=8>
|
|
|
|
|
|
{'_id': '5048725112_GuVtW1w37',
|
|
|
'comment_num': 2,
|
|
|
'content': '富饶的深夜厨房# 在热搜上挂了两天的双莓曲奇🍪在没有秤没有刮刀的恶劣环境下随性完成还一不小心做出了中间软软的酥心夹心🌝',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 10, 130493),
|
|
|
'created_at': '2018-08-16 18:21:01',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GuVtW1w37'}
|
|
|
2019-05-04 00:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=8>
|
|
|
|
|
|
{'_id': '5048725112_GsXUS5bTG',
|
|
|
'comment_num': 2,
|
|
|
'content': '什么在希腊都发不出去委屈脸',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 10, 141470),
|
|
|
'created_at': '2018-08-03 20:52:16',
|
|
|
'like_num': 8,
|
|
|
'repost_num': 1,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GsXUS5bTG'}
|
|
|
2019-05-04 00:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=8>
|
|
|
|
|
|
{'_id': '5048725112_GrCwm9Vcq',
|
|
|
'comment_num': 3,
|
|
|
'content': '机的时候看到一个很帅的小哥哥,A380的大客机一千多个人他坐我旁边 这大概就是命运的安排吧',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 10, 149466),
|
|
|
'created_at': '2018-07-26 00:33:53',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GrCwm9Vcq'}
|
|
|
2019-05-04 00:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=8>
|
|
|
|
|
|
{'_id': '5048725112_GqRJo1vOF',
|
|
|
'comment_num': 4,
|
|
|
'content': '你生日快乐',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 10, 157475),
|
|
|
'created_at': '2018-07-21 01:26:53',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GqRJo1vOF'}
|
|
|
2019-05-04 00:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=8>
|
|
|
|
|
|
{'_id': '5048725112_GqnrXe5Gg',
|
|
|
'comment_num': 0,
|
|
|
'content': '',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 10, 163467),
|
|
|
'created_at': '2018-07-17 20:21:32',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GqnrXe5Gg'}
|
|
|
2019-05-04 00:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=8>
|
|
|
|
|
|
{'_id': '5048725112_Gp1xeD2tW',
|
|
|
'comment_num': 4,
|
|
|
'content': '富饶的深夜厨房# '
|
|
|
'我妈为了省买蛋糕的钱给我承包了我家的生日蛋糕业务😐抹茶黄桃蛋糕[草莓蛋糕]这个虽然丑但是真的很好吃啊啊啊忍不住给自己一个肯定的眼神',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 10, 170481),
|
|
|
'created_at': '2018-07-08 22:43:49',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Gp1xeD2tW'}
|
|
|
2019-05-04 00:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=8>
|
|
|
|
|
|
{'_id': '5048725112_GoHWCbM1c',
|
|
|
'comment_num': 7,
|
|
|
'content': '富饶的深夜厨房# 西瓜芒果夏日冰[西瓜]天气太热了拒绝开火[瑜伽一]🏻♀️还是老老实实做甜品啦',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 10, 178448),
|
|
|
'created_at': '2018-07-06 20:51:24',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GoHWCbM1c'}
|
|
|
2019-05-04 00:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=8>
|
|
|
|
|
|
{'_id': '5048725112_GosPhcj2Q',
|
|
|
'comment_num': 0,
|
|
|
'content': '前一觉睡醒都八点多,后来越来越早,直到今天醒的时候一看表四点多…开启老年生活',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 10, 185445),
|
|
|
'created_at': '2018-07-05 06:22:06',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GosPhcj2Q'}
|
|
|
2019-05-04 00:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=8>
|
|
|
|
|
|
{'_id': '5048725112_GntySeBFG',
|
|
|
'comment_num': 0,
|
|
|
'content': '了400多条微博,真的不知道自己以前为啥逮啥转啥',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 10, 194441),
|
|
|
'created_at': '2018-06-28 18:24:09',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GntySeBFG'}
|
|
|
2019-05-04 00:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=8>
|
|
|
|
|
|
{'_id': '5048725112_GnkRJA9C5',
|
|
|
'comment_num': 0,
|
|
|
'content': '分钟前 十分钟后',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 10, 200439),
|
|
|
'created_at': '2018-06-27 20:15:54',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GnkRJA9C5'}
|
|
|
2019-05-04 00:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=7> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=7>
|
|
|
|
|
|
{'_id': '5048725112_Gz8D21sqh',
|
|
|
'comment_num': 6,
|
|
|
'content': '着赫本吃早餐吃早餐🥖🥛',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 13, 12163),
|
|
|
'created_at': '2018-09-13 11:10:21',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Gz8D21sqh'}
|
|
|
2019-05-04 00:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=7>
|
|
|
|
|
|
{'_id': '5048725112_Gy9bQDeCU',
|
|
|
'comment_num': 2,
|
|
|
'content': '定以后做个手艺人吧[emoji]🏻♀️',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 13, 24156),
|
|
|
'created_at': '2018-09-06 22:45:50',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Gy9bQDeCU'}
|
|
|
2019-05-04 00:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=7>
|
|
|
|
|
|
{'_id': '5048725112_GxGZR6Ot5',
|
|
|
'comment_num': 2,
|
|
|
'content': '过之后就要继续加油啦!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 13, 32151),
|
|
|
'created_at': '2018-09-03 22:59:22',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GxGZR6Ot5'}
|
|
|
2019-05-04 00:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=7>
|
|
|
|
|
|
{'_id': '5048725112_GwVuqyAzX',
|
|
|
'comment_num': 3,
|
|
|
'content': '富饶的深夜厨房# 香菇黄焖鸡[母鸡]全新的炒糖色技能😬开学前的最后一道菜啦 虽然总共也没做几个…',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 13, 40147),
|
|
|
'created_at': '2018-08-29 22:02:51',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GwVuqyAzX'}
|
|
|
2019-05-04 00:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=7>
|
|
|
|
|
|
{'_id': '5048725112_GwMlQbBS3',
|
|
|
'comment_num': 2,
|
|
|
'content': '天还会再来可是这样的夏天不会再有了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 13, 47143),
|
|
|
'created_at': '2018-08-28 22:46:59',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GwMlQbBS3'}
|
|
|
2019-05-04 00:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=7>
|
|
|
|
|
|
{'_id': '5048725112_GwsxqA15D',
|
|
|
'comment_num': 2,
|
|
|
'content': '自己配备了一个专门次冰淇淋的小勺子🍨🥄[熊]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 13, 55138),
|
|
|
'created_at': '2018-08-26 20:20:35',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GwsxqA15D'}
|
|
|
2019-05-04 00:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=7>
|
|
|
|
|
|
{'_id': '5048725112_GvRrxEuEb',
|
|
|
'comment_num': 2,
|
|
|
'content': '很很舒服的一天~[红心]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 13, 61135),
|
|
|
'created_at': '2018-08-22 21:54:27',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GvRrxEuEb'}
|
|
|
2019-05-04 00:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=7>
|
|
|
|
|
|
{'_id': '5048725112_GvpH2uP1a',
|
|
|
'comment_num': 3,
|
|
|
'content': '病坚持吃吃喝喝的生活[冰淇凌]半夜读到大哭的结局[看书]大悦城七夕的土味情话\U0001f92d咖啡色的我[emoji]🏻♀️很水的希腊土特产\U0001f9d6🏻♀️娃娃机里抓出最好看的熊童子[熊]扎金索斯举办婚礼的小钟楼[教堂]️长得像驴的小兔叽',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 13, 68131),
|
|
|
'created_at': '2018-08-19 23:15:43',
|
|
|
'like_num': 9,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GvpH2uP1a'}
|
|
|
2019-05-04 00:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=7>
|
|
|
|
|
|
{'_id': '5048725112_Gv6BXkfK0',
|
|
|
'comment_num': 3,
|
|
|
'content': '獭宝宝搓脸前还拍拍小手,完全萌的犯规啊',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 13, 74127),
|
|
|
'created_at': '2018-08-17 22:41:00',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Gv6BXkfK0'}
|
|
|
2019-05-04 00:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=7>
|
|
|
|
|
|
{'_id': '5048725112_GuX1bsgHw',
|
|
|
'comment_num': 2,
|
|
|
'content': '行教会我的,应该就是这个吧活成佛系🌿',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 13, 80124),
|
|
|
'created_at': '2018-08-16 22:15:41',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GuX1bsgHw'}
|
|
|
2019-05-04 00:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=6> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=6>
|
|
|
|
|
|
{'_id': '5048725112_GEPGlCKTc',
|
|
|
'comment_num': 2,
|
|
|
'content': '🐝 天津·黄崖关长城',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 16, 526859),
|
|
|
'created_at': '2018-10-20 21:58:10',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GEPGlCKTc'}
|
|
|
2019-05-04 00:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=6>
|
|
|
|
|
|
{'_id': '5048725112_GDBxztcNQ',
|
|
|
'comment_num': 0,
|
|
|
'content': '享我的故事 微博视频 韩剧《太阳的后裔》OST(TalkLove说干什么呢)[口哨歌]中文填词版《说吧爱我》',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 16, 538851),
|
|
|
'created_at': '2018-10-12 20:07:47',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GDBxztcNQ'}
|
|
|
2019-05-04 00:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=6>
|
|
|
|
|
|
{'_id': '5048725112_GDsWEbD8E',
|
|
|
'comment_num': 4,
|
|
|
'content': '富饶的深夜厨房# 芋头排骨煲麻麻买了个超级超级大的荔浦芋头终于在做饭的时候感觉到放松 回到之前生活的样子',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 16, 546864),
|
|
|
'created_at': '2018-10-11 22:14:50',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GDsWEbD8E'}
|
|
|
2019-05-04 00:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=6>
|
|
|
|
|
|
{'_id': '5048725112_GD8ncEQEw',
|
|
|
'comment_num': 3,
|
|
|
'content': '大懒糖带你看日本# '
|
|
|
'由于传统的仰卧起坐锻炼到的主要不是腹肌,所以近些年美军和日本长跑名校青山学院接连废止了这种锻炼方法…最新一期的《初耳学》教授了锻炼腹肌更有效的仰卧起坐方法,想瘦小腹练腹肌的快马起来! '
|
|
|
'大懒糖的秒拍视频',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 16, 552843),
|
|
|
'created_at': '2018-10-09 17:52:34',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 2,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GD8ncEQEw'}
|
|
|
2019-05-04 00:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=6>
|
|
|
|
|
|
{'_id': '5048725112_GC3mXnSfV',
|
|
|
'comment_num': 0,
|
|
|
'content': '歉,作者已设置仅展示半年内微博,此微博已不可见。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 16, 560838),
|
|
|
'created_at': '2018-10-02 15:17:55',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GC3mXnSfV'}
|
|
|
2019-05-04 00:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=6>
|
|
|
|
|
|
{'_id': '5048725112_GBMsz750N',
|
|
|
'comment_num': 2,
|
|
|
'content': '富饶的深夜厨房# 玉子烧终于买到心心念念的玉子烧小锅 加了牛奶弹弹的~🥛',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 16, 567834),
|
|
|
'created_at': '2018-09-30 20:15:03',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GBMsz750N'}
|
|
|
2019-05-04 00:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=6>
|
|
|
|
|
|
{'_id': '5048725112_GAJjxFxve',
|
|
|
'comment_num': 0,
|
|
|
'content': '富饶的深夜厨房# '
|
|
|
'傅利来冰皮月饼[emoji]🏻♀️本来我说我给月饼起了一个好听的名字叫富饶牌冰皮月饼,我妈说太难听了你还是叫傅利来吧',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 16, 573830),
|
|
|
'created_at': '2018-09-23 22:24:17',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GAJjxFxve'}
|
|
|
2019-05-04 00:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=6>
|
|
|
|
|
|
{'_id': '5048725112_GAzDDqvPh',
|
|
|
'comment_num': 6,
|
|
|
'content': '富饶的深夜厨房# 路边摊烤冷面太喜欢吃所以干脆自己学!水放少了还炸出了脆皮🙈还没有烤肠 所以我也不确定自己做了个啥',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 16, 581826),
|
|
|
'created_at': '2018-09-22 21:46:19',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GAzDDqvPh'}
|
|
|
2019-05-04 00:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=6>
|
|
|
|
|
|
{'_id': '5048725112_GAgL2sEnB',
|
|
|
'comment_num': 2,
|
|
|
'content': '耶暴哭 怎么会有candy Andy这么好的男人啊啊啊',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 16, 587836),
|
|
|
'created_at': '2018-09-20 21:42:21',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GAgL2sEnB'}
|
|
|
2019-05-04 00:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=5> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=5>
|
|
|
|
|
|
{'_id': '5048725112_H4Dx5cC6A',
|
|
|
'comment_num': 5,
|
|
|
'content': '天真的开心的不行不行的了 盲盒天使加持后开出封面和隐藏无敌破坏王里每个角色都好可爱啊啊啊 我爱迪士尼一辈子',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 20, 991171),
|
|
|
'created_at': '2018-11-27 19:35:44',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H4Dx5cC6A'}
|
|
|
2019-05-04 00:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=5>
|
|
|
|
|
|
{'_id': '5048725112_H4ipV68EY',
|
|
|
'comment_num': 3,
|
|
|
'content': '富饶的深夜厨房# 珍珠很多的珍珠奶茶以后每天都可以有奶茶喝啦啊哈哈哈',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 21, 11161),
|
|
|
'created_at': '2018-11-25 13:50:24',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H4ipV68EY'}
|
|
|
2019-05-04 00:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=5>
|
|
|
|
|
|
{'_id': '5048725112_H4cYLnX2U',
|
|
|
'comment_num': 14,
|
|
|
'content': '姐妹bot】前两天开玩笑跟我姐妹说想恋爱了,没想到她就……',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 21, 26154),
|
|
|
'created_at': '2018-11-24 23:59:46',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H4cYLnX2U'}
|
|
|
2019-05-04 00:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=5>
|
|
|
|
|
|
{'_id': '5048725112_H3ARI0VWg',
|
|
|
'comment_num': 0,
|
|
|
'content': '论文写到濒临失心疯 强迫自己看个电影冷静下[闭眼]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 21, 40135),
|
|
|
'created_at': '2018-11-20 22:58:00',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H3ARI0VWg'}
|
|
|
2019-05-04 00:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=5>
|
|
|
|
|
|
{'_id': '5048725112_H2PtKiV4C',
|
|
|
'comment_num': 2,
|
|
|
'content': '生不需要条条框框,热爱生活,做自己喜欢的事,爱自己喜欢的人。@天津工业大学 @天津师范大学@新浪微视频 #Baby ,До '
|
|
|
'свидания (达尼亚)[音乐]# 天津·天津工业大学 野海野海的秒拍视频',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 21, 53127),
|
|
|
'created_at': '2018-11-15 22:19:52',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H2PtKiV4C'}
|
|
|
2019-05-04 00:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=5>
|
|
|
|
|
|
{'_id': '5048725112_H2GuMxk0G',
|
|
|
'comment_num': 1,
|
|
|
'content': '阔疼,想把脑阔扔掉',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 21, 64116),
|
|
|
'created_at': '2018-11-14 23:27:42',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H2GuMxk0G'}
|
|
|
2019-05-04 00:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=5>
|
|
|
|
|
|
{'_id': '5048725112_H1HaP89AO',
|
|
|
'comment_num': 0,
|
|
|
'content': '這樣的粉絲,誰都會剛起來的',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 21, 74106),
|
|
|
'created_at': '2018-11-08 11:20:58',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H1HaP89AO'}
|
|
|
2019-05-04 00:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=5>
|
|
|
|
|
|
{'_id': '5048725112_H0HpBw3BV',
|
|
|
'comment_num': 0,
|
|
|
'content': '富饶的深夜厨房# 万圣节特供的一堆小糊面包和女巫的手指\U0001f9df♀️还有今年幼儿园大班手工合集里最喜欢的蜘蛛网 '
|
|
|
'虽然不是吃的 但是是做的最成功的🕷️明年万圣节就把自己放盘子里做个老实鬼吧[南瓜灯]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 21, 87101),
|
|
|
'created_at': '2018-11-01 22:07:04',
|
|
|
'like_num': 6,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H0HpBw3BV'}
|
|
|
2019-05-04 00:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=4> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=4>
|
|
|
|
|
|
{'_id': '5048725112_HcoXo9Wrv',
|
|
|
'comment_num': 0,
|
|
|
'content': '块石头里都藏着古老的秘密吧🗿 柬埔寨·柬埔寨 吴哥窟',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 24, 253591),
|
|
|
'created_at': '2019-01-17 21:11',
|
|
|
'like_num': 11,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HcoXo9Wrv'}
|
|
|
2019-05-04 00:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=4>
|
|
|
|
|
|
{'_id': '5048725112_HbEgucRgZ',
|
|
|
'comment_num': 10,
|
|
|
'content': '日份的[彩虹]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 24, 274610),
|
|
|
'created_at': '2019-01-12 22:19',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HbEgucRgZ'}
|
|
|
2019-05-04 00:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=4>
|
|
|
|
|
|
{'_id': '5048725112_H9PYEoo0t',
|
|
|
'comment_num': 0,
|
|
|
'content': '托拜托',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 24, 287583),
|
|
|
'created_at': '2019-01-01 00:28',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H9PYEoo0t'}
|
|
|
2019-05-04 00:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=4>
|
|
|
|
|
|
{'_id': '5048725112_H9ORBkDyO',
|
|
|
'comment_num': 3,
|
|
|
'content': '我猜猜是哪个爱豆陈伟霆王嘉尔还是刘昊然?',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 24, 298578),
|
|
|
'created_at': '2018-12-31 21:38:01',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H9ORBkDyO'}
|
|
|
2019-05-04 00:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=4>
|
|
|
|
|
|
{'_id': '5048725112_H92bZkFSX',
|
|
|
'comment_num': 0,
|
|
|
'content': '啊啊,被巴黎迪士尼的这个广告被感动哭了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 24, 308573),
|
|
|
'created_at': '2018-12-26 17:43:38',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H92bZkFSX'}
|
|
|
2019-05-04 00:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=4>
|
|
|
|
|
|
{'_id': '5048725112_H8Q7r3yRG',
|
|
|
'comment_num': 0,
|
|
|
'content': '',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 24, 321565),
|
|
|
'created_at': '2018-12-25 10:59:28',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H8Q7r3yRG'}
|
|
|
2019-05-04 00:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=4>
|
|
|
|
|
|
{'_id': '5048725112_H7ob32wO6',
|
|
|
'comment_num': 2,
|
|
|
'content': '富饶的深夜厨房# 珍珠爆浆蛋糕做了四个多小时 表面还算光鲜的小蛋糕其实底是后补的被戚风蛋糕气疯了',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 24, 331560),
|
|
|
'created_at': '2018-12-15 22:01:09',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H7ob32wO6'}
|
|
|
2019-05-04 00:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=4>
|
|
|
|
|
|
{'_id': '5048725112_H64Asotdl',
|
|
|
'comment_num': 7,
|
|
|
'content': '觉真好 可以做梦',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 24, 342552),
|
|
|
'created_at': '2018-12-07 06:18:31',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H64Asotdl'}
|
|
|
2019-05-04 00:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=4>
|
|
|
|
|
|
{'_id': '5048725112_H5N0vakoE',
|
|
|
'comment_num': 2,
|
|
|
'content': '',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 24, 354533),
|
|
|
'created_at': '2018-12-05 09:33:14',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H5N0vakoE'}
|
|
|
2019-05-04 00:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=3> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=3>
|
|
|
|
|
|
{'_id': '5048725112_HibOL57er',
|
|
|
'comment_num': 4,
|
|
|
'content': '富饶的深夜厨房# 锅包肉😋虽然看上去有一点点点丑但是真的好好吃鸭 想在宿舍添口锅 但是想想每周两天半的课 没必要[好]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 29, 352847),
|
|
|
'created_at': '2019-02-24 22:46',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HibOL57er'}
|
|
|
2019-05-04 00:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=3>
|
|
|
|
|
|
{'_id': '5048725112_HhHV5i0Ub',
|
|
|
'comment_num': 0,
|
|
|
'content': '是些什么家庭啊,居然敢在#迪士尼包场办婚礼#',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 29, 374859),
|
|
|
'created_at': '2019-02-21 18:39',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HhHV5i0Ub'}
|
|
|
2019-05-04 00:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=3>
|
|
|
|
|
|
{'_id': '5048725112_Hhg583gQl',
|
|
|
'comment_num': 3,
|
|
|
'content': '期白白',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 29, 388843),
|
|
|
'created_at': '2019-02-18 19:47',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Hhg583gQl'}
|
|
|
2019-05-04 00:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=3>
|
|
|
|
|
|
{'_id': '5048725112_HfSQ2c107',
|
|
|
'comment_num': 6,
|
|
|
'content': '富饶的深夜厨房# 笋片炒腊肉🥓寒假没剩几天了做个菜吧 本来想去广东大吃一顿被种种不可抗力因素劝退了 '
|
|
|
'就自己去超市抱了一堆腊肉腊肠回来好想过过每天都吃粤菜的生活鸭[星光]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 29, 398827),
|
|
|
'created_at': '2019-02-09 18:46',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HfSQ2c107'}
|
|
|
2019-05-04 00:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=3>
|
|
|
|
|
|
{'_id': '5048725112_Hf7DV4kzl',
|
|
|
'comment_num': 0,
|
|
|
'content': '夕[爱心]️',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 29, 411820),
|
|
|
'created_at': '2019-02-04 18:38',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Hf7DV4kzl'}
|
|
|
2019-05-04 00:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=3>
|
|
|
|
|
|
{'_id': '5048725112_Hdtc47tqr',
|
|
|
'comment_num': 9,
|
|
|
'content': '自己立了一堆flag,希望大家都能撑到过年啊',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 29, 422812),
|
|
|
'created_at': '2019-01-24 21:49',
|
|
|
'like_num': 4,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Hdtc47tqr'}
|
|
|
2019-05-04 00:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=3>
|
|
|
|
|
|
{'_id': '5048725112_HdaNABLlt',
|
|
|
'comment_num': 0,
|
|
|
'content': '7个小时 睡到仿佛失去意识🤤',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 29, 478774),
|
|
|
'created_at': '2019-01-22 22:59',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HdaNABLlt'}
|
|
|
2019-05-04 00:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=3>
|
|
|
|
|
|
{'_id': '5048725112_HcS7Rufg5',
|
|
|
'comment_num': 5,
|
|
|
'content': '用翻墙的生活正式结束[按摩]🏻♀️ 柬埔寨·暹粒',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 29, 490784),
|
|
|
'created_at': '2019-01-20 23:27',
|
|
|
'like_num': 6,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HcS7Rufg5'}
|
|
|
2019-05-04 00:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=3>
|
|
|
|
|
|
{'_id': '5048725112_HcHzVlXzy',
|
|
|
'comment_num': 3,
|
|
|
'content': '里的小孩子太可怜了,每个来堵我们都忍不住给点钱,我觉得再呆两天我就该蹲在路边找别人要钱了🙍🏻♀️ 柬埔寨·暹粒',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 29, 501778),
|
|
|
'created_at': '2019-01-19 20:36',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HcHzVlXzy'}
|
|
|
2019-05-04 00:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=3>
|
|
|
|
|
|
{'_id': '5048725112_HcxInyhkM',
|
|
|
'comment_num': 0,
|
|
|
'content': '免税店失去欲望的我😶 柬埔寨·暹粒',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 29, 515772),
|
|
|
'created_at': '2019-01-18 19:29',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HcxInyhkM'}
|
|
|
2019-05-04 00:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/5048725112/profile?page=2> (referer: https://weibo.cn/5048725112/profile?page=1)
|
|
|
2019-05-04 00:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=2>
|
|
|
|
|
|
{'_id': '5048725112_HmRqzb7vL',
|
|
|
'comment_num': 23,
|
|
|
'content': 'oops# 被小鹿支配的恐惧🦌[警告]️ 日本·奈良',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 31, 547785),
|
|
|
'created_at': '2019-03-27 16:03',
|
|
|
'like_num': 23,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HmRqzb7vL'}
|
|
|
2019-05-04 00:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=2>
|
|
|
|
|
|
{'_id': '5048725112_HmAht1nDV',
|
|
|
'comment_num': 0,
|
|
|
'content': '绿茶]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 31, 568773),
|
|
|
'created_at': '2019-03-25 20:24',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HmAht1nDV'}
|
|
|
2019-05-04 00:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=2>
|
|
|
|
|
|
{'_id': '5048725112_HmhAQjqyz',
|
|
|
'comment_num': 0,
|
|
|
'content': '果死侍乱入《复仇者联盟4》会发生什么?油管网友制作了这部“好贱”的预告片,看了让人想把死侍打一顿!太恶搞了吧!影片制作:mighty '
|
|
|
'raccoon翻译:Jian nerpier 大懒糖的微博视频',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 31, 586765),
|
|
|
'created_at': '2019-03-23 20:50',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HmhAQjqyz'}
|
|
|
2019-05-04 00:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=2>
|
|
|
|
|
|
{'_id': '5048725112_HmdZ94q3V',
|
|
|
'comment_num': 0,
|
|
|
'content': '王嘉尔[超话]#春天恋爱了[樱花]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 31, 604754),
|
|
|
'created_at': '2019-03-23 11:38',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HmdZ94q3V'}
|
|
|
2019-05-04 00:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=2>
|
|
|
|
|
|
{'_id': '5048725112_HkL8RaC5Z',
|
|
|
'comment_num': 4,
|
|
|
'content': '鸭,少了一张',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 31, 621768),
|
|
|
'created_at': '2019-03-13 20:22',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HkL8RaC5Z'}
|
|
|
2019-05-04 00:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=2>
|
|
|
|
|
|
{'_id': '5048725112_Hk0QBuHSb',
|
|
|
'comment_num': 0,
|
|
|
'content': '片名:力挽狂澜',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 31, 639735),
|
|
|
'created_at': '2019-03-08 22:31',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Hk0QBuHSb'}
|
|
|
2019-05-04 00:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=2>
|
|
|
|
|
|
{'_id': '5048725112_HjQl6pmXV',
|
|
|
'comment_num': 2,
|
|
|
'content': '天感觉自己像人!生!赢!家!',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 31, 656720),
|
|
|
'created_at': '2019-03-07 19:46',
|
|
|
'like_num': 7,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HjQl6pmXV'}
|
|
|
2019-05-04 00:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=2>
|
|
|
|
|
|
{'_id': '5048725112_Hj5Eq1tqW',
|
|
|
'comment_num': 2,
|
|
|
'content': '为草莓很可爱,所以感觉今天我也很可爱[草莓]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 31, 676712),
|
|
|
'created_at': '2019-03-02 20:54',
|
|
|
'like_num': 10,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/Hj5Eq1tqW'}
|
|
|
2019-05-04 00:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=2>
|
|
|
|
|
|
{'_id': '5048725112_HiVPQmEZQ',
|
|
|
'comment_num': 7,
|
|
|
'content': '富饶的深夜厨房# '
|
|
|
'蒜香豌豆+蛋炒饭[米饭]开始脱离下厨房自己自由发挥的家常菜系拍照特意只盛了一点饭,其实还有一锅都是我的[阿姨]🏻[打蛋]',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 31, 690703),
|
|
|
'created_at': '2019-03-01 19:55',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HiVPQmEZQ'}
|
|
|
2019-05-04 00:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/5048725112/profile?page=2>
|
|
|
|
|
|
{'_id': '5048725112_HiNj51wFC',
|
|
|
'comment_num': 4,
|
|
|
'content': '有进步',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 31, 704694),
|
|
|
'created_at': '2019-02-28 22:12',
|
|
|
'like_num': 5,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/HiNj51wFC'}
|
|
|
2019-05-04 00:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/comment/GCqooq6NQ?ckAll=1> (referer: https://weibo.cn/5048725112/profile?page=6)
|
|
|
2019-05-04 00:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/comment/GCqooq6NQ?ckAll=1>
|
|
|
|
|
|
{'_id': '5048725112_GCuew9e0h',
|
|
|
'comment_num': 5,
|
|
|
'content': '真的要和美队说再见了?!美队Chris '
|
|
|
'Evans刚刚发文表示:“我在《复仇者联盟4》的戏份正式杀青。不夸张地说今天太让人动情。能够在过去8年里一直扮演这个角色是一种荣幸。致所有镜头前和镜头后的人们,以及观众们,感谢你们给了我一段美好的回忆。我会永远心怀感激。”之前美队曾表示他的合约在《复仇者联盟4》之后到期,他这段话也引来媒体和影迷猜测这可能是他在MCU漫威电影宇宙拍摄的最后一天的戏。',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 16, 559839),
|
|
|
'created_at': '2018-10-05 11:41:18',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GCuew9e0h'}
|
|
|
2019-05-04 00:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/comment/H2UDRB2iY?ckAll=1> (referer: https://weibo.cn/5048725112/profile?page=5)
|
|
|
2019-05-04 00:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/comment/H2UDRB2iY?ckAll=1>
|
|
|
|
|
|
{'_id': '5048725112_H2UDRB2iY',
|
|
|
'comment_num': 2,
|
|
|
'content': '最近发现在别人惹我不爽的时候我处理事情的方法有问题,不应该假惺惺好意把事情原因揽到自己身上,什么“其实怪我”、冷处理,或者转移话题不了了之,有时居然还会给对方找个台阶下。应该直接指出来把事情说明白,也避免人家觉得我 '
|
|
|
'莫名其妙,过于好说话或者甚至觉得问题出在我身上就这么决定了,两分钟以后,重新做人',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 21, 52129),
|
|
|
'created_at': '2018-11-16 11:28:32',
|
|
|
'like_num': 3,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H2UDRB2iY'}
|
|
|
2019-05-04 00:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/comment/GFGFyjI7C?ckAll=1> (referer: https://weibo.cn/5048725112/profile?page=5)
|
|
|
2019-05-04 00:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/comment/GFGFyjI7C?ckAll=1>
|
|
|
|
|
|
{'_id': '5048725112_GFI6zuWkz',
|
|
|
'comment_num': 5,
|
|
|
'content': '【重磅】告别杰克船长!约翰尼·德普将不再参演《加勒比海盗》!前天,Deadline称迪士尼影业打算重启经典的《加勒比海盗》系列电影,已经与《死侍》系列编剧Rhett '
|
|
|
'Reese和Paul Wernick面谈协商,准备让他俩担任编剧。而根据英国《每日邮报》,系列原编剧Stuart '
|
|
|
'Beattie公开确认迪士尼确实要重启《加勒比海盗》,而且是换了整个团队。约翰尼·德普将不再扮演杰克船长!谈到德普的离开,他说:“我认为他演得非常好,显然他把杰克船长这个角色演到杰克船长就是他本人了。也成为他最为知名的角色。我认为杰克船长会成为约翰尼·德普的遗赠。这是他唯一一个演了五次的角色。他总是会打扮成杰克船长去医院里看望孩子们。他会因为这个角色而被大家永远铭记于心。”而谈到新版《加勒比海盗》,尤其找到了《死侍》的编剧团队,Stuart '
|
|
|
'Beattie对此充满了期待:“希望他们能够带来非常多又精彩好看的颠覆性的喜剧元素。光是看到《死侍》的开场我舅已经笑翻。所以我真心希望他们能够做出点特别的东西来。”',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 21, 96096),
|
|
|
'created_at': '2018-10-26 16:31:06',
|
|
|
'like_num': 1,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/GFI6zuWkz'}
|
|
|
2019-05-04 00:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://weibo.cn/comment/H42GkaYPo?ckAll=1> (referer: https://weibo.cn/5048725112/profile?page=4)
|
|
|
2019-05-04 00:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://weibo.cn/comment/H42GkaYPo?ckAll=1>
|
|
|
|
|
|
{'_id': '5048725112_H4NvRe2ts',
|
|
|
'comment_num': 3,
|
|
|
'content': '回味一下#无敌破坏王2#里最魔性好笑,又最给人心理阴影的一段“小兔兔炸了”:小兔吃松饼,小猫喝奶昔↓(所谓“预告里有的那一段”,片中更长)这个手机游戏现在真上线了,叫Pancake '
|
|
|
'Milkshake。大家若要玩请对小兔小猫好一点哟!而被吓到的小孩,就是《海洋奇缘》女主角Moana小时候。在《无敌破坏王2》里,长大了的她也依旧元气十足',
|
|
|
'crawl_time': datetime.datetime(2019, 5, 4, 0, 11, 24, 364540),
|
|
|
'created_at': '2018-11-28 21:00:11',
|
|
|
'like_num': 2,
|
|
|
'repost_num': 0,
|
|
|
'user_id': '5048725112',
|
|
|
'weibo_url': 'https://weibo.com/5048725112/H4NvRe2ts'}
|
|
|
2019-05-04 00:11:47 [scrapy.core.engine] INFO: Closing spider (finished)
|
|
|
2019-05-04 00:11:47 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
|
|
|
{'downloader/request_bytes': 34158,
|
|
|
'downloader/request_count': 34,
|
|
|
'downloader/request_method_count/GET': 34,
|
|
|
'downloader/response_bytes': 197681,
|
|
|
'downloader/response_count': 34,
|
|
|
'downloader/response_status_count/200': 34,
|
|
|
'finish_reason': 'finished',
|
|
|
'finish_time': datetime.datetime(2019, 5, 3, 16, 11, 47, 564252),
|
|
|
'item_scraped_count': 280,
|
|
|
'log_count/DEBUG': 314,
|
|
|
'log_count/INFO': 10,
|
|
|
'request_depth_max': 4,
|
|
|
'response_received_count': 34,
|
|
|
'scheduler/dequeued': 34,
|
|
|
'scheduler/dequeued/memory': 34,
|
|
|
'scheduler/enqueued': 34,
|
|
|
'scheduler/enqueued/memory': 34,
|
|
|
'start_time': datetime.datetime(2019, 5, 3, 16, 9, 48, 480477)}
|
|
|
2019-05-04 00:11:47 [scrapy.core.engine] INFO: Spider closed (finished)
|