qiangzi7723 / spider-for-netease-music Goto Github PK

这个肯定不能爬版权歌曲吧？除非写了会员登录的cookies？
写完按照分类来拼凑歌单似乎也不错？

运行显示歌手xxx抓取完毕，但是数据表却看不到歌曲的信息

`/home/alphabrock/file/spider-for-netease-music/spider/node_modules/mysql/lib/protocol/Parser.js:80
throw err; // Rethrow non-MySQL errors
^

TypeError: Cannot read property 'name' of undefined
at query (/home/alphabrock/file/spider-for-netease-music/spider/code/song.js:30:37)
at Query.conn.query [as _callback] (/home/alphabrock/file/spider-for-netease-music/spider/mysql/index.js:11:17)
at Query.Sequence.end (/home/alphabrock/file/spider-for-netease-music/spider/node_modules/mysql/lib/protocol/sequences/Sequence.js:88:24)
at Query._handleFinalResultPacket (/home/alphabrock/file/spider-for-netease-music/spider/node_modules/mysql/lib/protocol/sequences/Query.js:139:8)
at Query.EofPacket (/home/alphabrock/file/spider-for-netease-music/spider/node_modules/mysql/lib/protocol/sequences/Query.js:123:8)
at Protocol._parsePacket (/home/alphabrock/file/spider-for-netease-music/spider/node_modules/mysql/lib/protocol/Protocol.js:279:23)
at Parser.write (/home/alphabrock/file/spider-for-netease-music/spider/node_modules/mysql/lib/protocol/Parser.js:76:12)
at Protocol.write (/home/alphabrock/file/spider-for-netease-music/spider/node_modules/mysql/lib/protocol/Protocol.js:39:16)
at Socket. (/home/alphabrock/file/spider-for-netease-music/spider/node_modules/mysql/lib/Connection.js:103:28)
at emitOne (events.js:96:13)`

这是什么一个情况呢

网易云的页面由 前端 JS 控制路由动态加载，但可以找到页面源地址。

如 https://music.163.com/#/discover/artist/cat?id=1001&initial=65
源地址为 https://music.163.com/discover/artist/cat?id=1001&initial=65

直接请求源地址而不用无头浏览器可以提高爬取效率。希望之后的版本能改进。

不过还是挺棒的一个项目，加油

singer.js
里面的cbItem和cbObj的回调是怎么判断需要调取哪个，然后分别是什么
我看配置文件里面也没有写