首页
后端开发
Python
直播站点数据采集与分析系统架构

直播站点数据采集与分析系统架构

17 次浏览 0 条评论
zip
zip
本项目实现了爬虫及数据挖掘/分析功能。目前主要用于扫描直播站点以收集数据，未来将开发数据分析模块。系统架构采用前后端分离设计，通过RESTFul API进行通信。前端使用Vue和Webpack，后端采用Flask。文件结构分为三部分：frontend（前端代码，使用Vue和Webpack进行管理）、server（后端RESTFul服务，使用Flask提供API）、crawler（爬虫服务，使用Scrapy框架对直播站点进行数据采集）。
zip
livetv_mining-master.zip 预估大小：82个文件
folder
livetv_mining-master 文件夹
file
.DS_Store 6KB
file
.travis.yml 171B
folder
frontend 文件夹
folder
src 文件夹
file
App.vue 466B
folder
store 文件夹
file
index.js 1KB
file
main.js 312B
folder
resource 文件夹
file
index.js 537B
folder
components 文件夹
file
Pagination.vue 2KB
file
RoomList.vue 996B
file
SiteHeader.vue 451B
file
ChannelList.vue 1KB
file
MenuNavbar.vue 2KB
file
Intro.vue 744B
folder
css 文件夹
file
styles.css 364B
folder
filters 文件夹
file
index.js 666B
folder
router 文件夹
file
index.js 2KB
folder
views 文件夹
file
Subscribe.vue 4KB
file
Search.vue 3KB
folder
channel 文件夹
file
Rank.vue 2KB
file
Detail.vue 2KB
file
Login.vue 624B
folder
room 文件夹
file
Rank.vue 3KB
file
Detail.vue 2KB
file
Site.vue 1KB
file
.babelrc 27B
file
package.json 1KB
file
index.html 1KB
file
.gitignore 39B
file
README.md 315B
folder
config 文件夹
file
webpack.base.js 3KB
file
webpack.dev.js 978B
file
webpack.prod.js 1KB
folder
crawler 文件夹
file
scrapy.cfg 255B
folder
gather 文件夹
folder
__init__.py 文件夹
folder
pipelines 文件夹
file
__init__.py 120B
file
harddisk.py 1KB
file
database.py 6KB
folder
once_spiders 文件夹
folder
__init__.py 文件夹
file
quanmin.py 2KB
file
douyu.py 2KB
file
panda.py 2KB
file
models.py 5KB
folder
spiders 文件夹
file
__init__.py 161B
file
quanmin.py 3KB
file
huomao.py 4KB
file
huya.py 3KB
file
bilibili.py 3KB
file
longzhu.py 4KB
file
douyu.py 2KB
file
zhanqi.py 2KB
file
panda.py 2KB
file
items.py 1013B
file
settings.py 10KB
file
middlewares.py 1KB
folder
daily_spiders 文件夹
folder
__init__.py 文件夹
file
quanmin.py 2KB
file
bilibili.py 3KB
file
douyu.py 3KB
file
panda.py 2KB
file
run.py 2KB
file
.gitignore 764B
file
README.md 514B
file
requirements.txt 251B
file
.gitignore 788B
folder
server 文件夹
folder
app 文件夹
file
__init__.py 781B
folder
restful 文件夹
file
__init__.py 227B
file
main.py 5KB
file
user.py 446B
file
subscribe.py 1KB
file
models.py 7KB
folder
auth 文件夹
file
__init__.py 159B
file
github.py 1KB
file
views.py 889B
file
robots.txt 50B
folder
tests 文件夹
file
__init__.py 3KB
file
test_subscribe.py 1KB
file
test_user.py 1KB
file
test_main.py 3KB
file
manage.py 3KB
file
.gitignore 787B
file
README.md 1KB
file
config.py 452B
file
README.md 550B
...
zip 文件大小：115.52KB