ICode9

精准搜索请尝试: 精确搜索
首页 > 其他分享> 文章详细

网站某个按钮样式爬取片段

2022-04-20 16:00:49  阅读:144  来源: 互联网

标签:orderBy buttons 片段 self 爬取 api 按钮 popular path


import requests
import os
 
 
class Code:
    def __init__(self):
        self.url = [
            "https://api.uiverse.io/buttons?type=button&orderBy=popular",
            "https://api.uiverse.io/buttons?type=button-of-the-day&orderBy=popular",
            "https://api.uiverse.io/buttons?type=card&orderBy=popular",
            "https://api.uiverse.io/buttons?type=checkbox&orderBy=popular",
            "https://api.uiverse.io/buttons?type=input&orderBy=popular",
            "https://api.uiverse.io/buttons?type=spinner&orderBy=popular",
            "https://api.uiverse.io/buttons?type=switch&orderBy=popular",
        ]
        self.headers = {
            "user-agent": "Mozilla / 5.0(Windows NT 10.0;WOW64) AppleWebKit / 537.36(KHTML, likeGecko) Chrome / 86.0.4240.198Safari / 537.36"
        }
 
    def send_request(self, url):
        return requests.get(url, headers=self.headers, timeout=3).json()
 
    def run(self):
        for url in self.url:
            html_str = self.send_request(url)
            for val in html_str['buttons']:
                css = val['scopedCss']
                html = val['html']
                first = css.index('.')
                last = css.find(' ', first)
                print(first)
                print(css[first+1:last])
 
                content = (
                        '<html lang="en">'
                        '<head>'
                        '<meta charset="UTF-8">'
                        '<meta name="viewport" content="width=device-width, initial-scale=1.0">'
                        '<title > Document </title>'
                        '<style >' + css + '</style>'
                        '</head>'
                        '<body><div class="' + css[first+1:last] + '">' + html + '</div></body>'
                        '</html>'
                )
                # break
                path = "C:/Users/Administrator/Downloads/Documents"+url[36:-16]
                if not os.path.exists(path=path):
                    os.makedirs(path)
                with open(path + '/' + val['id'] + '.html', 'w',
                          encoding='utf-8') as ht:
                    ht.write(content)
 
 
def main():
    code = Code()
    code.run()
 
 
if __name__ == '__main__':
    main()

用的时候记得将path改成要下载的位置.

 

标签:orderBy,buttons,片段,self,爬取,api,按钮,popular,path
来源: https://www.cnblogs.com/xuanze1/p/16170225.html

本站声明: 1. iCode9 技术分享网(下文简称本站)提供的所有内容,仅供技术学习、探讨和分享;
2. 关于本站的所有留言、评论、转载及引用,纯属内容发起人的个人观点,与本站观点和立场无关;
3. 关于本站的所有言论和文字,纯属内容发起人的个人观点,与本站观点和立场无关;
4. 本站文章均是网友提供,不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属;如您发现该文章侵犯了您的权益,可联系我们第一时间进行删除;
5. 本站为非盈利性的个人网站,所有内容不会用来进行牟利,也不会利用任何形式的广告来间接获益,纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。

专注分享技术,共同学习,共同进步。侵权联系[81616952@qq.com]

Copyright (C)ICode9.com, All Rights Reserved.

ICode9版权所有