首页 | 官方网站   微博 | 高级检索  
     

基于卷积神经网络的刺绣风格数字合成
引用本文:郑锐,钱文华,徐丹,普园媛.基于卷积神经网络的刺绣风格数字合成[J].浙江大学学报(理学版),1959,46(3):270-278.
作者姓名:郑锐  钱文华  徐丹  普园媛
基金项目:国家自然科学基金资助项目(61662087);云南省中青年学术技术带头人后备人才项目;云南省科技厅应用技术研究计划重点项目(2019);博士后科研基金项目;江苏省博士后科研基金项目(1108000197).
摘    要:针对刺绣风格数字化模拟方法立体感不强、缺少线条方向等问题,提出了一种基于深度学习和卷积神经网络的算法,将刺绣艺术风格传输到目标图像。利用图像语义分割网络及风格迁移网络,分别对目标内容图像与刺绣艺术风格图像进行目标提取和风格迁移。首先,输入目标内容图像与刺绣艺术风格图像,采用基于条件随机场的图像语义分割,将目标内容图与刺绣艺术风格图的前景与背景分离,并进行二值化处理,形成掩模图像;其次,将目标内容图与刺绣艺术风格图的RGB颜色空间转换为YIQ;最后,参照掩模图像使用VGG19网络模型提取目标内容图的内容特征及刺绣艺术风格图的风格纹理特征进行目标区域内的风格迁移,从而对刺绣艺术进行数字化模拟。该算法能模拟出具有刺绣艺术效果的结果图像,能更好地模拟真实刺绣艺术的线条方向,突出了线条的立体感。通过使用语义分割与风格迁移相结合的方法,有效模拟了色彩艳丽、立体感强的刺绣艺术风格图像,是对非真实感绘制的有效补充,为刺绣数字化保护与非物质文化传承奠定了基础。

关 键 词:刺绣  卷积神经网络  图像语义分割  掩模  风格迁移  
收稿时间:2019-01-06

Synthesis of embroidery based on convolutional neural network
Rui ZHENG,Wenhua QIAN,Dan XU,Yuanyuan PU.Synthesis of embroidery based on convolutional neural network[J].Journal of Zhejiang University(Sciences Edition),1959,46(3):270-278.
Authors:Rui ZHENG  Wenhua QIAN  Dan XU  Yuanyuan PU
Affiliation:1.Department of Computer Science and Engineering, Yunnan University, Kunming 650504, China
2.School of Automation,Southeast University, Nanjing 210096,China
Abstract:To remedy the deficiency of the current digital embroidery algorithm in arousing the original linear and stereo perception, this paper proposes an artificial system based on deep-learning and convolutional neural network to synthetize the style of embroidery. First, we input the content image and the embroidery style image, perform image semantic segmentation which is based on conditional random field to separate the foreground and the background of both images and construct masks by image binarization. Then, we convert the color spaces of both input images from RGB into YIQ, extract the features of embroidery by VGG19 and transfer the content image into embroidery style in the foreground by using mask, meanwhile emphasizing the gorgeous colors and the stereoscopic textures of the embroidery. Experimental results show that the proposed method can enhance images with embroidery style effectively. It lays a foundation for digital inheritance of the traditional embroidery.
Keywords:embroidery  convolutional neural network  image semantic segmentation  mask  style transfer  
点击此处可从《浙江大学学报(理学版)》浏览原始摘要信息
点击此处可从《浙江大学学报(理学版)》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司    京ICP备09084417号-23

京公网安备 11010802026262号