【Azure Developer】Python 读取 json文件及过滤出需要的结果

2022-06-13 21:03:53 阅读：173 来源： 互联网

标签：function body HTTP service Python header json Azure message

问题描述

首先，有名为 campsites.json 的JSON数据文件，数据格式为

{
    "type": "FeatureCollection",
    "name": "DOC_Campsites",
    "crs": {        "type": "name",        "properties": {            "name": "urn:ogc:def:crs:OGC:1.3:CRS84"        }    },
    "features": [
        {
            "type": "Feature",
            "properties": {
                "OBJECTID": 54996,
                "name": "Rarangi Campsite",
                "place": "Blenheim area",
                "region": "Marlborough",
                "introduction": "Camp next to the beach. Fish, walk, picnic, or simply sit and enjoy the roar of the waves.",
                "campsiteCategory": "Standard",
                "status": "OPEN",
                "numberOfPoweredSites": 0,
                "numberOfUnpoweredSites": 55,
                "bookable": "No",
                "free": null,
                "facilities": "Water supply",
                "activities": null,
                "dogsAllowed": "Dogs with a DOC permit only",
                "landscape": "Coastal",
                "access": "Campervan, Car, Caravan",
                "hasAlerts": "Refer to DOC website for current alerts",
                "introductionThumbnail": "https://www.doc.govt.nz/thumbs/large/link/1b698c516b714b63b30de03203738e17.jpg",
                "staticLink": "https://www.doc.govt.nz/link/f5c4e8776bee486aaa1ae8ebdc1e48f8.aspx",
                "locationString": "Located in Blenheim area",
                "x": 1687530,
                "y": 5417097,
                "assetId": 100030520,
                "dateLoadedToGIS": "2021-05-28T04:15:08Z",
                "GlobalID": "{C02F0A50-9316-459A-ADD9-93518E6677EA}"
            },
            "geometry": {"type": "Point","coordinates": [174.04700047400002,-41.39289982899993]}
        }
, ... ... 
    ]
}

全部的campsites.json文件内容下载地址：https://files.cnblogs.com/files/lulight/campsites.json?t=1655124060

修改下面的 server3.py 文件，以达到目标：当用户在浏览器中输入带有区域名称（例如 http://localhost:8080/Marlborough）的 URL 时，这个python服务器应该查询 region=Marlborough 的区域中的 Campsite category 类别为“Great Walk”的 Name + staticLink 数据在页面中

server3.py 文件内容：

#Author: Sunil Lal

#This is a simple HTTP server which listens on port 8080, accepts connection request, and processes the client request 
#in sepearte threads. It implements basic service functions (methods) which generate HTTP response to service the HTTP requests. 
#Currently there are 3 service functions; default, welcome and getFile. The process function maps the requet URL pattern to the service function.
#When the requested resource in the URL is empty, the default function is called which currently invokes the welcome function.
#The welcome service function responds with a simple HTTP response: "Welcome to my homepage".
#The getFile service function fetches the requested html or img file and generates an HTTP response containing the file contents and appropriate headers.

#To extend this server's functionality, define your service function(s), and map it to suitable URL pattern in the process function.

#This web server runs on python v3
#Usage: execute this program, open your browser (preferably chrome) and type http://servername:8080
#e.g. if server.py and broswer are running on the same machine, then use http://localhost:8080



from socket import *
import _thread

serverSocket = socket(AF_INET, SOCK_STREAM)

serverPort = 8080
serverSocket.setsockopt(SOL_SOCKET, SO_REUSEADDR, 1)
serverSocket.bind(("", serverPort))

serverSocket.listen(5)
print('The server is running')    
# Server should be up and running and listening to the incoming connections

#Extract the given header value from the HTTP request message
def getHeader(message, header):

    if message.find(header) > -1:
        value = message.split(header)[1].split()[0]
    else:
        value = None

    return value

#service function to fetch the requested file, and send the contents back to the client in a HTTP response.
def getFile(filename):

    try:

        # open and read the file contents. This becomes the body of the HTTP response
        f = open(filename, "rb")
        
        body = f.read()


        header = ("HTTP/1.1 200 OK\r\n\r\n").encode()

    except IOError:

        # Send HTTP response message for resource not found
        header = "HTTP/1.1 404 Not Found\r\n\r\n".encode()
        body = "<html><head></head><body><h1>404 Not Found</h1></body></html>\r\n".encode()

    return header, body

#service function to generate HTTP response with a simple welcome message
def welcome(message):


    header = "HTTP/1.1 200 OK\r\n\r\n".encode()
    body = ("<html><head></head><body><h1>Welcome to my homepage</h1></body></html>\r\n").encode()


    return header, body

#default service function
def default(message):

    header, body = welcome(message)

    return header, body


#We process client request here. The requested resource in the URL is mapped to a service function which generates the HTTP reponse 
#that is eventually returned to the client. 
def process(connectionSocket) :    
    # Receives the request message from the client
    message = connectionSocket.recv(1024).decode()


    if len(message) > 1:


        # Extract the path of the requested object from the message
        # Because the extracted path of the HTTP request includes
        # a character '/', we read the path from the second character
        resource = message.split()[1][1:]

        #map requested resource (contained in the URL) to specific function which generates HTTP response 
        if resource == "":
            responseHeader, responseBody = default(message)
        elif resource == "welcome":
            responseHeader,responseBody = welcome(message)
        else:
            responseHeader,responseBody = getFile(resource)


    # Send the HTTP response header line to the connection socket
    connectionSocket.send(responseHeader)
    # Send the content of the HTTP body (e.g. requested file) to the connection socket
    connectionSocket.send(responseBody)
    # Close the client connection socket
    connectionSocket.close()


#Main web server loop. It simply accepts TCP connections, and get the request processed in seperate threads.
while True:
    
    # Set up a new connection from the client
    connectionSocket, addr = serverSocket.accept()
    #Clients timeout after 60 seconds of inactivity and must reconnect.
    connectionSocket.settimeout(60)
    # start new thread to handle incoming request
    _thread.start_new_thread(process,(connectionSocket,))

问题解答

在server3.py 文件中，实现了默认Default，welcome 和 getFile 方法，当访问URL为 http://localhost:8080 时，调用default方法，输出 Welcome to my homepage 信息。同理，当访问URL为 http://localhost:8080/welcome 时,调用welcome方法，同样输出 Welcome to my homepage 信息。而 getFile 方法，则是读取指定的文件，输出文件内容。所以，本题最重要的代码部分为 getFile方法实现。

当用户在浏览器中输入带有区域名称（例如 http://localhost:8080/Marlborough）的 URL 时，这个python服务器应该查询 region=Marlborough 的区域中的 Campsite category 类别为“Great Walk”的 Name + staticLink 数据在页面中

第一步：引入 JSON 包

import json

第二步：定义 region 和 campsiteCategory的过滤条件 condition1 和 condition2，以及指定filename为 campsites.json (因为这里只是完成题目，所以硬编码在代码中)

        filename = "campsites.json"
        condition1 = "Marlborough"
        condition2 = "Basic"  # "Great Walk"

第三步：开始使用Json.load文件中的数据，把内容转换为 dict对象，然后根据 JSON格式，读取 features 列表，通过for 循环来一条一条的判断 condtion1 和 condition 2，满足条件，通过html拼接为一个Table

def getFile(regionname):

    try:
        filename = "campsites.json"
        condition1 = "Marlborough"
        condition2 = "Basic"  # "Great Walk"
        # open and read the file contents. This becomes the body of the HTTP response
        f = open(filename, "rb")
        jdata = json.load(f)

        # 查询region=Marlborough的区域中的Campsite category类别为“Great Walk”的Name , site总数并返回
        # region=Marlborough
        ## campsiteCategory =="Great Walk";

        #         print(jdata['name']);
        #         print(jdata['features'][1]['properties']['region'])
        #         print(type(jdata['features'][1]))

        outputTable = ""
        index = 0
        for fs in jdata['features']:
            if fs['properties']['region'] == condition1 and fs['properties']['campsiteCategory'] == condition2:
                outputTable += "<tr><td>" + \
                    fs['properties']['name']+"</td><td>" + \
                    fs['properties']['staticLink']+"</td></tr>"
                # print(fs['properties']['campsiteCategory'])
                index += 1

        body = ("<html><head></head><body><h1>Welcome to my homepage</h1><br><h2>Total row is " +
                str(index)+"</h2><br><table>"+outputTable+"</table></body></html>\r\n").encode()

        header = ("HTTP/1.1 200 OK\r\n\r\n").encode()

    except IOError:

        # Send HTTP response message for resource not found
        header = "HTTP/1.1 404 Not Found\r\n\r\n".encode()
        body = "<html><head></head><body><h1>404 Not Found</h1></body></html>\r\n".encode()

    return header, body

第四步：运行 python server3.py，检验结果

> python server3.py

因为 campsites.json 数据源中，没有同时满足 region =="Marlborough" 和 campsiteCategory =="Great Walk" 的数据。

所以为了展示页面效果，修改了过滤条件为：

def getFile(regionname):

    try:
        filename = "campsites.json"
        condition1 = regionname; # "Marlborough"
        condition2 = "Basic"  # "Great Walk"

再次测试的效果如下：

【END】

附录：完整的Server3.py 代码

# Author: Sunil Lal

# This is a simple HTTP server which listens on port 8080, accepts connection request, and processes the client request
# in sepearte threads. It implements basic service functions (methods) which generate HTTP response to service the HTTP requests.
# Currently there are 3 service functions; default, welcome and getFile. The process function maps the requet URL pattern to the service function.
# When the requested resource in the URL is empty, the default function is called which currently invokes the welcome function.
# The welcome service function responds with a simple HTTP response: "Welcome to my homepage".
# The getFile service function fetches the requested html or img file and generates an HTTP response containing the file contents and appropriate headers.

# To extend this server's functionality, define your service function(s), and map it to suitable URL pattern in the process function.

# This web server runs on python v3
# Usage: execute this program, open your browser (preferably chrome) and type http://servername:8080
# e.g. if server.py and broswer are running on the same machine, then use http://localhost:8080


from socket import *
import _thread
import json

serverSocket = socket(AF_INET, SOCK_STREAM)

serverPort = 8080
serverSocket.setsockopt(SOL_SOCKET, SO_REUSEADDR, 1)
serverSocket.bind(("", serverPort))

serverSocket.listen(5)
print('The server is running')
# Server should be up and running and listening to the incoming connections

# Extract the given header value from the HTTP request message


def getHeader(message, header):

    if message.find(header) > -1:
        value = message.split(header)[1].split()[0]
    else:
        value = None

    return value

# service function to fetch the requested file, and send the contents back to the client in a HTTP response.


def getFile(regionname):

    try:
        filename = "campsites.json"
        condition1 = regionname; # "Marlborough"
        condition2 = "Basic"  # "Great Walk"
        # open and read the file contents. This becomes the body of the HTTP response
        f = open(filename, "rb")
        #body = f.read()
        jdata = json.load(f)

        # 查询region=Marlborough的区域中的Campsite category类别为“Great Walk”的Name , site总数并返回
        # region=Marlborough
        ## campsiteCategory =="Great Walk";

        #         print(jdata['name']);
        #         print(jdata['crs']);
        #         print(jdata['features'][1]['properties']['region'])
        #         print(jdata['features'][1]['properties']['campsiteCategory'])
        #         print(type(jdata['features'][1]))

        outputTable = ""
        index = 0
        for fs in jdata['features']:
            if fs['properties']['region'] == condition1 and fs['properties']['campsiteCategory'] == condition2:
                outputTable += "<tr><td>" + \
                    fs['properties']['name']+"</td><td>" + \
                    fs['properties']['staticLink']+"</td></tr>"
                # print(index)
                # print(fs['properties']['region'])
                # print(fs['properties']['campsiteCategory'])
                index += 1
        #d = filter(lambda x:x.index)
        #print(outputTable)
        body = ("<html><head></head><body><h1>Welcome to my homepage</h1><br><h2>Total row is " +
                str(index)+"</h2><br><table>"+outputTable+"</table></body></html>\r\n").encode()

        header = ("HTTP/1.1 200 OK\r\n\r\n").encode()

    except IOError:

        # Send HTTP response message for resource not found
        header = "HTTP/1.1 404 Not Found\r\n\r\n".encode()
        body = "<html><head></head><body><h1>404 Not Found</h1></body></html>\r\n".encode()

    return header, body

# service function to generate HTTP response with a simple welcome message


def welcome(message):

    header = "HTTP/1.1 200 OK\r\n\r\n".encode()
    body = ("<html><head></head><body><h1>Welcome to my homepage</h1></body></html>\r\n").encode()

    return header, body

# default service function


def default(message):

    header, body = welcome(message)

    return header, body


# We process client request here. The requested resource in the URL is mapped to a service function which generates the HTTP reponse
# that is eventually returned to the client.
def process(connectionSocket):
    # Receives the request message from the client
    message = connectionSocket.recv(1024).decode()

    if len(message) > 1:

        # Extract the path of the requested object from the message
        # Because the extracted path of the HTTP request includes
        # a character '/', we read the path from the second character
        resource = message.split()[1][1:]

        # map requested resource (contained in the URL) to specific function which generates HTTP response
        if resource == "":
            responseHeader, responseBody = default(message)
        elif resource == "welcome":
            responseHeader, responseBody = welcome(message)
        else:
            responseHeader, responseBody = getFile(resource)

    # Send the HTTP response header line to the connection socket
    connectionSocket.send(responseHeader)
    # Send the content of the HTTP body (e.g. requested file) to the connection socket
    connectionSocket.send(responseBody)
    # Close the client connection socket
    connectionSocket.close()


# Main web server loop. It simply accepts TCP connections, and get the request processed in seperate threads.
while True:

    # Set up a new connection from the client
    connectionSocket, addr = serverSocket.accept()
    # Clients timeout after 60 seconds of inactivity and must reconnect.
    connectionSocket.settimeout(60)
    # start new thread to handle incoming request
    _thread.start_new_thread(process, (connectionSocket,))

参考资料

...

标签：function,body,HTTP,service,Python,header,json,Azure,message
来源： https://www.cnblogs.com/lulight/p/16372284.html

本站声明： 1. iCode9 技术分享网（下文简称本站）提供的所有内容，仅供技术学习、探讨和分享；
2. 关于本站的所有留言、评论、转载及引用，纯属内容发起人的个人观点，与本站观点和立场无关；
3. 关于本站的所有言论和文字，纯属内容发起人的个人观点，与本站观点和立场无关；
4. 本站文章均是网友提供，不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属；如您发现该文章侵犯了您的权益，可联系我们第一时间进行删除；
5. 本站为非盈利性的个人网站，所有内容不会用来进行牟利，也不会利用任何形式的广告来间接获益，纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。

ICode9

【Azure Developer】Python 读取 json文件及过滤出需要的结果

问题描述

问题解答

附录：完整的Server3.py 代码

参考资料