Collection of AIGC Lens during my internship at Kuaishou
项目时间 Date
2023.9 – 2024.2
项目类型 Project type
AI 设计 AI Design
完成人 Author
倪威(AI效果、动效)
Arjane (AI effects and motions)
关键词 Keyword
人像 AI 效果 Realistic models
背景 Background
这些是我在快手实习时的已上线项目合集,基于快手的 AI 能力打造的特效丰富了用户短视频拍摄的素材。主要使用形式是点击拍摄后取关键帧,图生图进行 AI 人像生成,并配有动画特效,最终保存为短视频。
A collection of published projects during my internship at Kuaishou(Kwai). These were AI effects help users record short videos. After user’s clicking on the shot button, we took the keyframe for image-to-image AI portraits generation with pre-established animation, and eventually saved as a short video.
此外,也包括动效、文档写作等其他实习工作内容。
Additionally, the internship experience includes work beyond AI aesthetics, such as video effects and documentation.
写真:「云游哈尔滨」 “Harbin Virtual Voyage”
这个项目大约在 2023 年 12 月上线,是为网络热点「南方人去东北旅游」做的项目。我在其中负责 AI 生成效果,与算法工程师协同,保证生成效果的一致性和美观。这个项目是使用可图大模型上线的首批拍摄特效。
一共定义了 3 个带有哈尔滨特色的热点场景:中央大街、大教堂和冰雪大世界。采用了单图保ID的方案,在相似度、美观度、生成时间上有良好的平衡。
This project went live around December 2023, and it was for an internet hotspot ‘Southerners traveling to the Northeast’. I was responsible for AI generation workflow and aesthetics, and collaborated with the algorithm engineers to ensure the consistency. This project was one of the first AI lens using the Kolors Model.
A total of three scenes with northeast city Harbin characteristics were defined: Central Street, Cathedral and Ice World Playground. The single-image ID-preserving workflow was adopted, which had a good balance of similarity, aesthetics, and generation time.
写真:「新春写真」 “Spring Festive Portraits”
在 2024 年春节期间上线,共包含4种场景:发红包、瑞兽玩偶、品茶、写春联。和「云游哈尔滨」采用相同的方案,我的职责也一样。
Launched during the Chinese New Year in 2024, it contained four scenarios: red envelopes, auspicious beast dolls, tea, and Spring Festival couplets. This lens shared the same workflow with project Harbin and I played the same role.
写真:「神话古风」 “Ancient Myths”
2023 年 10 月上线的图生图项目,我配合主设计师调试 AI 模型。「神话古风」达成 Q4 优质素材。
I worked with the lead designer to debug the AI model for this Oct 2023 launched lens, which achieved Q4’s quality lens of the team.
视频生成:「福龙高照」 “Dragon in the Sky”
一个视频生成项目,输入一张图在服务端异步生成。我配合另一位设计师制作 AI 效果,有「国风」和「赛博」两款主题。
在 2024 年春节期间上线,当日登上主站热榜第 7。
A video generation project that received a selfie for asynchronous generation on the server side. I cooperated with another designer to create AI lens with two themes, “National Style” and “Cyber”.
It was launched during the Chinese New Year in 2024, and was ranked No. 7 on the Trending at that day.
动画特效:「机甲变身」 “Mecha Transformation”
2023 年 10 月上线的图生图项目,我负责动效制作。「机甲变身」达成 Q4 优质素材。
I was in charge of the motion for this Oct 2023 launched lens, which achieved Q4’s quality lens of the team.
文档工作 Documentation work
我每周搜集整理与业务相关的前沿 AIGC 技术,并自己体验后评估其业务价值,在周会上与同学们分享。这项工作持续了 38 周,累计更新了 295 条行业产品动态与技术 Demo。
I collect and organize cutting-edge AIGC technologies related to our business on a weekly basis, evaluating their value and sharing insights with my teammates during weekly meetings. This work has continued for 38 weeks, resulting in a total of 295 updates on industry product developments and technology demos.
每个项目都经历了构思项目主题、交互玩法、效果定义、工作流搭建、美学评估和验收、动画包装的过程。
我在掌握快手特效团队已有的工具包后,也会根据不同项目的需要,开发实用的小工具来增加团队工作效率。例如方便视频生成关键词管理的小工具。
Each project underwent a process that included conceptualizing the project theme, defining interactions, establishing workflows, evaluating aesthetics, along with motion design.
After mastering the toolkit from the Kuaishou effects team, I also developed practical tools tailored to different project needs to enhance team efficiency, such as a tool for managing prompts for key frames of video generation.