See also my Google Scholar.
Revisiting Input Time-frequency Representations in Multi-pitch Estimation for Vocal Ensembles
Junyoung Koh and Hao-Wen Dong
arXiv preprint, arXiv:2610.03656, 2026
Music Transcription
SCISSOR: Score-Conditioned Instrument Source Separation for Orchestral Recordings
Yiheng Lu and Hao-Wen Dong
arXiv preprint, arXiv:2609.33265, 2026
Sound Separation
On a Separate Note: Robust Score-Informed Note Separation with a Two-Stream TFC-TDF U-Net and Adaptive Set Ownership
Benjamin Shiue-Hal Chou, Purvish Jajal, Nicholas John Eliopoulos, James C Davis, George K Thiruvathukal, Kristen Yeon-Ji Yun, Hao-Wen Dong, and Yung-Hsiang Lu
arXiv preprint, arXiv:2609.29071, 2026
Sound Separation
Dialogue-Aware Video-to-Music Generation Using Public Domain Film Collections
Haven Kim, Zachary Novack, Julian McAuley, and Hao-Wen Dong
arXiv preprint, arXiv:2608.11576, 2026
Music Generation Multimodal Learning
Unmixing The Crowd: Learning Persistent Speaker Representations from Mixture-Derived Multi-Speaker Embeddings
Sidharth Sidharth, Meysam Asgari, Hao-Wen Dong, and Dhruv Jain
arXiv preprint, arXiv:2604.03219, 2026
Sound Separation
Academic Text-to-Music Grand Challenge: Datasets, Baselines, and Evaluation Methods
Fang-Chih Hsieh, Wei-Jaw Lee, Chun-Ping Wang, Hung-yi Lee, Hao-Wen Dong, and Yi-Hsuan Yang
IEEE International Conference on Multimedia and Expo (ICME), Grand Challenges, 2026
Music Generation Multimodal Learning
REGen: Multimodal Retrieval-Embedded Generation for Long-to-Short Video Editing
Weihan Xu, Yimeng Ma, Jingyue Huang, Yang Li, Wenye Ma, Taylor Berg-Kirkpatrick, Julian McAuley, Paul Pu Liang, and Hao-Wen Dong
Advances in Neural Information Processing Systems (NeurIPS), 2025
Video Editing Multimodal Learning
Generating Symbolic Music from Natural Language Prompts using an LLM-Enhanced Dataset
Weihan Xu, Julian McAuley, Taylor Berg-Kirkpatrick, Shlomo Dubnov, and Hao-Wen Dong
International Society for Music Information Retrieval Conference (ISMIR), 2025
Music Generation Multimodal Learning
Video-Guided Text-to-Music Generation Using Public Domain Movie Collections
Haven Kim, Zachary Novack, Weihan Xu, Julian McAuley, and Hao-Wen Dong
International Society for Music Information Retrieval Conference (ISMIR), 2025
Music Generation Multimodal Learning
Synthesizing Composite Hierarchical Structure from Symbolic Music Corpora
Ilana Shapiro, Ruanqianqian Huang, Zachary Novack, Cheng-I Wang, Hao-Wen Dong, Taylor Berg-Kirkpatrick, Shlomo Dubnov, and Sorin Lerner
International Joint Conference on Artificial Intelligence (IJCAI), AI, Arts & Creativity Track, 2025
TeaserGen: Generating Teasers for Long Documentaries
Weihan Xu, Paul Pu Liang, Haven Kim, Julian McAuley, Taylor Berg-Kirkpatrick, and Hao-Wen Dong
International Conference on Learning Representations (ICLR), 2025
Video Editing Multimodal Learning
ViolinDiff: Enhancing Expressive Violin Synthesis with Pitch Bend Conditioning
Daewoong Kim, Hao-Wen Dong, and Dasaem Jeon
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2025
Audio Synthesis Music Performance Rendering
FUTGA-MIR: Enhancing Fine-grained and Temporally-aware Music Understanding with Music Information Retrieval
Junda Wu, Zachary Novack, Amit Namburi, Hao-Wen Dong, Caron Chen, Zhouhang Xie, Jiaheng Dai, and Julian McAuley
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2025
Multimodal Learning
Nested Music Transformer: Sequentially Decoding Compound Tokens in Symbolic Music and Audio Generation
Jiwoo Ryu, Hao-Wen Dong, Jongmin Jung, and Dasaem Jeon
International Society for Music Information Retrieval Conference (ISMIR), 2024
Music Generation
CLIPSonic: Text-to-Audio Synthesis with Unlabeled Videos and Pretrained Language-Vision Models
Hao-Wen Dong, Xiaoyu Liu, Jordi Pons, Gautam Bhattacharya, Santiago Pascual, Joan Serrà, Taylor Berg-Kirkpatrick, and Julian McAuley
IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), 2023
Oral presentation Audio Synthesis Multimodal Learning
Multitrack Music Transformer
Hao-Wen Dong, Ke Chen, Shlomo Dubnov, Julian McAuley, and Taylor Berg-Kirkpatrick
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023
Oral presentation Music Generation
CLIPSep: Learning Text-queried Sound Separation with Noisy Unlabeled Videos
Hao-Wen Dong, Naoya Takahashi, Yuki Mitsufuji, Julian McAuley, and Taylor Berg-Kirkpatrick
International Conference on Learning Representations (ICLR), 2023
Sound Separation Multimodal Learning
Improving Choral Music Separation through Expressive Synthesized Data from Sampled Instruments
Ke Chen, Hao-Wen Dong, Yi Luo, Julian McAuley, Taylor Berg-Kirkpatrick, Miller Puckette, and Shlomo Dubnov
International Society for Music Information Retrieval Conference (ISMIR), 2022
Sound Separation
Deep Performer: Score-to-Audio Music Performance Synthesis
Hao-Wen Dong, Cong Zhou, Taylor Berg-Kirkpatrick, and Julian McAuley
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022
Audio Synthesis Music Performance Rendering
Towards Automatic Instrumentation by Learning to Separate Parts in Symbolic Multitrack Music
Hao-Wen Dong, Chris Donahue, Taylor Berg-Kirkpatrick, and Julian McAuley
International Society for Music Information Retrieval Conference (ISMIR), 2021
Music Compositional Tools
An Empirical Evaluation of End-to-End Polyphonic Optical Music Recognition
Sachinda Edirisooriya, Hao-Wen Dong, Julian McAuley, and Taylor Berg-Kirkpatrick
International Society for Music Information Retrieval Conference (ISMIR), 2021
Optical Music Recognition
MusPy: A Toolkit for Symbolic Music Generation
Hao-Wen Dong, Ke Chen, Julian McAuley, and Taylor Berg-Kirkpatrick
International Society for Music Information Retrieval Conference (ISMIR), 2020
Infrastructure
Convolutional Generative Adversarial Networks with Binary Neurons for Polyphonic Music Generation
Hao-Wen Dong and Yi-Hsuan Yang
International Society for Music Information Retrieval Conference (ISMIR), 2018
Music Generation
MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompaniment
Hao-Wen Dong,* Wen-Yi Hsiao,* Li-Chia Yang, and Yi-Hsuan Yang (*equal contribution)
AAAI Conference on Artificial Intelligence (AAAI), 2018
Oral presentation Music Generation
ACappellaSet: A Multilingual A Cappella Dataset for Source Separation and AI-assisted Rehearsal Tools
Ting-Yu Pan, Kexin Phyllis Ju, and Hao-Wen Dong
NeurIPS Workshop on Artificial Intelligence for Music (AI4Music), 2025
Sound Separation
Video-to-Music Generation for Film Production: A Dataset and Framework
Haven Kim, Leduo Chen, Bill Wang, Hao-Wen Dong, and Julian McAuley
NeurIPS Workshop on Artificial Intelligence for Music (AI4Music), 2025
Music Generation Multimodal Learning
MusPyExpress: Extending MusPy with Enhanced Expression Text Support
Phillip Long, Hao-Wen Dong, Julian McAuley, and Zachary Novack
NeurIPS Workshop on Artificial Intelligence for Music (AI4Music), 2025
Infrastructure
The Name-Free Gap: Policy-Aware Stylistic Control in Music Generation
Ashwin Nagarajan and Hao-Wen Dong
NeurIPS Workshop on Artificial Intelligence for Music (AI4Music), 2025
Music Generation
FUTGA: Towards Fine-grained Music Understanding through Temporally-enhanced Generative Augmentation
Junda Wu, Zachary Novack, Amit Namburi, Jiaheng Dai, Hao-Wen Dong, Zhouhang Xie, Carol Chen, and Julian McAuley
Workshop on NLP for Music and Audio (NLP4MusA), 2024
Multimodal Learning
Equipping Pretrained Unconditional Music Transformers with Instrument and Genre Controls
Weihan Xu, Julian McAuley, Shlomo Dubnov, and Hao-Wen Dong
IEEE Big Data Workshop on AI Music Generation (AIMG), 2023
AI Music Innovation Award Music Generation
CLIPSynth: Learning Text-to-audio Synthesis from Videos using CLIP and Diffusion Models
Hao-Wen Dong, Gunnar A. Sigurdsson, Chenyang Tao, Jiun-Yu Kao, Yu-Hsiang Lin, Anjali Narayan-Chen, Arpit Gupta, Tagyoung Chung, Jing Huang, Nanyun Peng, and Wenbo Zhao
CVPR Workshop on Sight and Sound (WSS), 2023
Audio Synthesis Multimodal Learning
Curating an A Cappella Dataset for Source Separation
Ting-Yu Pan*, Kexin Phyllis Ju*, and Hao-Wen Dong (*equal contribution)
ISMIR Late-Breaking Demos, 2025
Sound Separation
Open Screen Soundtrack Library Version 2
Haven Kim, Leduo Chen, Bill Wang, Hao-Wen Dong, and Julian McAuley
ISMIR Late-Breaking Demos, 2025
Multimodal Learning
A New Dataset for Tag- and Text-based Controllable Symbolic Music Generation
Weihan Xu, Julian McAuley, Taylor Berg-Kirkpatrick, Shlomo Dubnov, and Hao-Wen Dong
ISMIR Late-Breaking Demos, 2024
Music Generation Multimodal Learning
Pypianoroll: Open Source Python Package for Handling Multitrack Pianorolls
Hao-Wen Dong, Wen-Yi Hsiao, and Yi-Hsuan Yang
ISMIR Late-Breaking Demos, 2018
Infrastructure
MuseGAN: Demonstration of a Convolutional GAN Based Model for Generating Multi-track Piano-rolls
Hao-Wen Dong,* Wen-Yi Hsiao,* Li-Chia Yang, and Yi-Hsuan Yang (*equal contribution)
ISMIR Late-Breaking Demos, 2017
Music Generation
AcaMate: Supporting Novice A Cappella Singers in Iterative Individual Practice
Kexin Phyllis Ju, Ting-Yu Pan, and Hao-Wen Dong
UIST Posters, 2025
On Output Activation Functions for Adversarial Losses: A Theoretical Analysis via Variational Divergence Minimization and An Empirical Study on MNIST Classification
Hao-Wen Dong and Yi-Hsuan Yang
arXiv preprint arXiv:1901.08753, 2019
Fundamental Machine Learning
Training Generative Adversarial Networks with Binary Neurons by End-to-end Backpropagation
Hao-Wen Dong and Yi-Hsuan Yang
arXiv preprint arXiv:1810.04714, 2018
Fundamental Machine Learning