Feiyu Wang

Feiyu Wang's Academic Homepage

Feiyu Wang (王飞宇)

PhD Candidate in Computer Science

Peking University · Beijing, China

I am working on LLMs, LLM quantization.

Formerly, I worked on probabilistic data structures, especially sketching algorithms for data streams, in network measurement, databases, and data mining.

Email: wangfeiyu@pku.edu.cn | WeChat ID: IceGiraffe80

LLM LLM Quantization Sketching Algorithms for Data Streams
Download CV Visit Blog

About

I am a Ph.D. student in the School of Computer Science at Peking University, advised by Prof. Tong Yang . My research interests include inference optimization for large language models, low-bit quantization algorithms, and sketching algorithms for data streams. Before starting my Ph.D., I received my bachelor's degree in Computer Science and Technology and my master's degree in Software Engineering from Peking University.

Publications

Filter by topic tab and publication year.

Tag:
Year:

HESTIA: A Hessian-Guided Differentiable Quantization-Aware Training Framework for Extremely Low-Bit LLMs

Guoan Wang# , Feiyu Wang # , Zongwei Lv , Yikun Zong , Tong Yang • arXiv • 2026 (# co-first authors)

Link PDF
LLMQuantization

Fairy2i: Training Complex LLMs from Real LLMs with All Parameters in {±1, ±i}

Feiyu Wang , Xinyu Tan , Bokai Huang , Yihao Zhang , Guoan Wang , Peizhuang Cong , Tong Yang • arXiv • 2025

Link PDF
LLMQuantization

iFairy: the First 2-bit Complex LLM with All Parameters in {±1, ±i}

Feiyu Wang , Guoan Wang , Yihao Zhang , Shengfan Wang , Weitao Li , Bokai Huang , Shimao Chen , Zihan Jiang , Rui Xu , Tong Yang • arXiv • 2025

Link PDF
LLMQuantization

VisionEmbedder: Bit-Level-Compact Key-Value Storage with Constant Lookup, Rapid Updates, and Rare Failure

Yuhan Wu , Feiyu Wang , Yifan Zhu , Zhuochen Fan , Zhiting Xiong , Tong Yang , Bin Cui • IEEE ICDE • 2024

Link PDF
DatabaseSystems

LadderFilter: Filtering Infrequent Items with Small Memory and Time Overhead

Yuanpeng Li , Feiyu Wang , Xiang Yu , Yilong Yang , Kaicheng Yang , Tong Yang , Zhuo Ma , Bin Cui , Steve Uhlig • ACM SIGMOD • 2023

Link PDF
DatabaseAlgorithms

JoinSketch: A Sketch Algorithm for Accurate and Unbiased Inner-Product Estimation

Feiyu Wang , Qizhi Chen , Yuanpeng Li , Tong Yang , Yaofeng Tu , Lian Yu , Bin Cui • ACM SIGMOD • 2023

Link PDF
DatabaseAlgorithms

Education

PhD in Computer Science and Technology / 计算机科学与技术 博士

School of Computer Science, Peking University / 北京大学 计算机学院 2024.09 - 至今

Master in Software Engineering / 软件工程 硕士

School of Software and Microelectronics, Peking University / 北京大学 软件与微电子学院 2021.09 - 2024.07

Double Degree in Economics / 经济学 双学位

National School of Development, Peking University / 北京大学 国家发展研究院 2019.09 - 2021.07

Bachelor in Computer Science and Technology / 计算机科学与技术 学士

Yuanpei College, Peking University / 北京大学 元培学院 2017.09 - 2021.07

Experience

Research Intern / 研究实习生

Huawei 2012 Labs / 华为 2012 实验室 2022.06 - 2024.06

Awards & Honors

Peking University Meritorious Student

北京大学三好学生

2022.12

Peking University Meritorious Student

北京大学三好学生

2020.12

Peking University Suzhou Industrial Park Scholarship

北京大学苏州工业园区奖学金

2020.12

Second Prize, Peking University Freshman Scholarship

北京大学新生奖学金二等奖学金

2017.12

Peking University Social Work Award

北京大学社会工作奖

2023.11

Second Prize, 30th Challenge Cup of Peking University

北京大学第三十届挑战杯二等奖

2022.06

Outstanding Graduate, Yuanpei College, Peking University

北京大学元培学院优秀毕业生

2021.07

Recent Writing

See all blog posts →

Misc

I am fond of Chinese calligraphy.