【深度学习】【部署】Flask快速部署Pytorch模型【入门】

深度学习】【部署】flask快速部署Pytorch模型【入门】

提示:博主取舍了很多大佬的博文并亲测有效,分享笔记邀大家共同学习讨论


前言

Django和Flask都是python的服务框架,Flask相较于Django的优势是更加轻量级,因此尝试用Flask构建API服务,Flask快速部署深度学习模型再打包exe与深度学习模型直接打包exe相比,前者模型只需要加载一次权重就可以一直使用,而后者每一次预测都需要重新加载一次模型权重,严重浪费了时间和资源。
【打包exe参考】
【环境安装参考】

# 安装flask
pip install flask 
# 安装pytorch环境
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117

搭建简单的Web服务

将以下代码段保存在名为app.py的文件中,并运行代码。

from flask import Flask
app = Flask(__name__)

@app.route('/')
def hello():
    return 'Hello World!'

if __name__ == "__main__":
	app.run()

在web浏览器中访问http://127.0.0.1:5000/时,查看到Hello World的文本!


搭建深度学习的Web服务

博主以人脸检测之Retinaface算法为例讲解代码:【retinaface-pytorch代码】。有兴趣的朋友可以看看完整的代码,这里博主只保留了与预测相关的代码,并做了部分修改。
app.py中与Web服务相关的部分,博主设置了俩个路由路径:

  1. 一个是/http://127.0.0.1:5000/setmodel–用于修改模型的主干网络及其权重,因为一个检测模型可能有多个backbone,本例是有res***50和alpha不同的多个mobile***V1作为backbone。
  2. 另一个是/http://127.0.0.1:5000/predict–用于检测,这里博主保留了源码中图片单一和批量俩种预测方式。
# 初始化模型 默认mobile***X1.00
Model = retinaface("mobile***X1.00")
from flask import Flask, request
app = Flask(__name__)
# /setmodel用于修改模型
@app.route('/setmodel', methods=['POST'])
def initialization():
    if request.method == 'POST':
        model_mold = request.form
        Model.setModel(model_mold["model_mold"])
    return "initialization " + model_mold["model_mold"] + " finish"

# /predict用于预测
@app.route('/predict', methods=['POST'])
def predict():
    if request.method == 'POST':
        file = request.form
        keys_Points = Model.detect_image(file['mode'], file['path'])
        return keys_Points

if __name__ == '__main__':
    app.run()

app.py中与Retinaface算法相关的部分,用retinaface类进一步封装了Retinaface模型,设置了俩个方法,detect_image方法对于flask中的predict,setModel方法对应flask中的initialization。

class retinaface(object):
    def __init__(self, model_mold):
        if model_mold == "mobile***X1.00":
            model_path= r"model_save/mobile***X1.00.pth"
        elif model_mold == "mobile***X0.75":
            model_path = r"model_save/mobile***X0.75.pth"
        elif model_mold == "mobile***X0.50":
            model_path = r"model_save/mobile***X0.50.pth"
        elif model_mold == "mobile***X0.25":
            model_path = r"model_save/mobile***X0.25.pth"
        else:
            model_path = r"model_save/res***50.pth"
        self.retinaface = Retinaface(model_path=model_path, backbone=model_mold)

    def detect_image(self, mode, path):
        import os
        if mode == "predict" and (path.lower().endswith(('.bmp', '.dib', '.png', '.jpg', '.jpeg', '.pbm', '.pgm', '.ppm', '.tif', '.tiff'))):
            while True:
                image = cv2.imread(path)
                if image is None:
                    print('Open Error! Try again!')
                    continue
                else:
                    image = cv2.cvtColor(image, cv2.COLOR_BGR2RGB)
                    r_image_points = self.retinaface.detect_image(image).tolist()

        elif mode == "dir_predict" and os.path.isdir(path):
            import os
            import time
            r_image_points = []
            img_names = os.listdir(path)
            for img_name in img_names:
                t = time.time()
                if img_name.lower().endswith(('.bmp', '.dib', '.png', '.jpg', '.jpeg', '.pbm', '.pgm', '.ppm', '.tif', '.tiff')):
                    image_path = os.path.join(path, img_name)
                    image = cv2.imread(image_path)
                    image = cv2.cvtColor(image, cv2.COLOR_BGR2RGB)
                    r_image_points.append(self.retinaface.detect_image(image).tolist())
        else:
            return []
        return r_image_points

    def setModel(self,model_mold):
        if model_mold == "mobile***X1.00":
            model_path= r"model_save/mobile***X1.00.pth"
        elif model_mold == "mobile***X0.75":
            model_path = r"model_save/mobile***X0.75.pth"
        elif model_mold == "mobile***X0.50":
            model_path = r"model_save/mobile***X0.50.pth"
        elif model_mold == "mobile***X0.25":
            model_path = r"model_save/mobile***X0.25.pth"
        else:
            model_path = r"model_save/res***50.pth"
        self.retinaface = Retinaface(model_path=model_path, backbone=model_mold)

test.py用于HTTP Post请求过程模拟。
"http://localhost:5000/setmodel"加载指定backbone,假设不指定backbone,默认加载mobile***X1.00。

import requests
resp = requests.post("http://localhost:5000/setmodel",
                     data={'model_mold': 'mobile***X0.25'})
print(resp.text)

"http://localhost:5000/predict"指定模式mode(单张图片或批量图片)和图片路径path。

import requests
resp = requests.post("http://localhost:5000/predict",
                     data={'mode': 'dir_predict', 'path': 'img'})
print(resp.text)

启动服务后,post发送http请求,默认backbone加载mobile***X1.00,path指定批量图片的文件夹地址,dir_predict(批量预测图片)mode方式预测所以图片的五个关键点(双眼、鼻子和俩边嘴角)xy像素坐标,源码其实还有框的坐标和高宽,博主不需要就去掉了。
多张图片,每张图片数据保存在一个list里–5个关键点xy像素坐标共10个值。

【代码上传】,只保留预测相关文件,功能如下图所示,不做过多讲解,主要讲解部署和使用。

win10下打包成exe(选看)

零基础先参考python程序打包成可执行文件【进阶篇】

# 安装PyInstaller包,5.4.0版本
pip install -i https://pypi.tuna.tsinghua.edu.***/simple Pyinstaller==5.4.0
# 生成spec文件
pyi-makespec -w app.py

安装了5.7.0及以后版本的Pyinstaller,打包部署启动的时候会报如下错误:

解决方式:pip指定5.4.0版本的安装包安装。
修改app.spec内容:由于打包的主文件是app.py,因此生成的spec文件名称为app.spec,俩者在同一个目录下。

    ['app.py',
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/retinaface.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/***s/layers.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/***s/mobile***.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/***s/res***.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/***s/retinaface.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/***s/retinaface_training.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/utils/anchors.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/utils/callbacks.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/utils/config.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/utils/dataloader.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/utils/utils.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/utils/utils_bbox.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/utils/utils_fit.py",
    "E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/utils/utils_map.py",
    ],
    pathex=["E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface"],
    binaries=[  ("E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/model_save/mobile***X0.25.pth", "model_save"),
                ("E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/model_save/mobile***X0.50.pth", "model_save"),
                ("E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/model_save/mobile***X0.75.pth", "model_save"),
                ("E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/model_save/mobile***X1.00.pth", "model_save"),
                ("E:/deep-learning-for-image-processing-master/face_detector/flask-retinaface/model_save/res***50.pth", "model_save"),
    ],
# 运行spec文件进行打包
pyinstaller app.spec

完成打包后在pathex指定文件夹下产生build(可以删除)和dist文件夹,所需的可执行文件在dist目录内

双击运行exe,运行test.py进行Post请求,测试结果如下图:


总结

尽可能简单、详细的介绍Flask快速部署深度学习模型的过程。

转载请说明出处内容投诉
CSS教程_站长资源网 » 【深度学习】【部署】Flask快速部署Pytorch模型【入门】

发表评论

欢迎 访客 发表评论

一个令你着迷的主题!

查看演示 官网购买