RESUME

Name: 朱治 ZHU ZHI

Address: Tokyo, Japan

E-mail: zhuzhiscitech@gmail.com

Education Experience

• April 2015 - March 2018 Ph.D. Degree in Information Science
  • 北陸先端科学技術大学院大学　情報科学研究科　博士後期課程
  • Japan Advanced Institute of Science and Technology, School of Information Science
  • Thesis: Contribution of Temporal Modulation Cues on the Perception of Speaker Individuality and Vocal Emotion
• April 2013 - March 2015 Master Degree in Information Science
  • 北陸先端科学技術大学院大学　情報科学研究科　博士前期課程
  • Japan Advanced Institute of Science and Technology, School of Information Science
  • Thesis: Study on Speaker Individuality Contained in Temporal Envelope of Speech
• October 2013 - March 2013
  • 北陸先端科学技術大学院大学　情報科学研究科　研究生
  • Japan Advanced Institute of Science and Technology, School of Information Science, Research Student
• September 2008 - June 2012
  • 南京邮电大学 海外教育学院 通信工程专业
  • Nanjing University of Posts and Telecommunications, Bachelor Degree of Communication Engineering
  • New York Institute of Techonology, Bachelor of Science, Electrical and Computer Engineering
  • Thesis: Frequency Offset Estimation for Orthogonal Frequency-Division Multiplexing Systems

Work experience

• October 2018 - Now
  • Fairy Devices Inc.
  • R&D Division, Scientist
• April 2018 - September 2018
  • Japan Society for the Promotion of Science
  • Research Fellowship for Young Scientists, PD
• April 2017 - March 2018
  • Japan Society for the Promotion of Science
  • Research Fellowship for Young Scientists, DC2
• April 2015 - March 2017
  • Japan Advanced Institute of Science and Technology
  • Research Assistant
• October 2013 - March 2016
  • Japan Advanced Institute of Science and Technology
  • Part-time Researcher

Skills

• Language Skills
  • Chinese: Native
  • Japanese: 日本語能力試験N1合格
  • English: TOEIC 820
• IT Skills
  • Python, MATLAB
  • Deep Learning: PyTorch, Tensorflow, Keras

Awards

• September 2017
  • 日本音響学会2017年秋季研究発表会　学生優秀発表賞
  • Student Excellence Presentation Award, the Autumn Meeting of Acoustical Society of Japan 2017
• November 2015
  • 電気関係学会北陸支部連合大会　学生優秀論文発表賞
  • Student Excellent Paper Presenation Award, Joint Conference of Hokuriku Chapter of Electrical Societies 2016
• March 2015
  • 日本音響学会北陸支部　優秀学生賞
  • Excellence Student Award, Japan Acousitcal Society Hokuriku Branch

Grants, Scholarships et al.

• 2017 - 2019
  • 科研費　特別研究員奨励費　No. 17J08312
  • JSPS Kakenhi project No.17J08312
  • 聴知覚メカニズムに基づいた音声の非言語情報の知覚に関する研究
  • Study on the perception of nonlinguistic information based on the auditory perception mechanism
• August 2016
  • 電気通信普及財団　海外渡航援助
  • The Telecommunications Advancement Foundation Grant for Overseas Travel
• April 2014
  • 北陸先端科学技術大学院大学学生給付奨学金特別採用（学業成績上位10%）
  • Student Scholarship Special Adoption (Top 10 % of academic achievement), Japan Advanced Institute of Science and Technology
• April 2014
  • 石川県私費外国人留学生奨学金
  • Ishikawa Prefecture Scholarship for Privately Funded Foreign Students

Publication

Journal Paper

• Taiyang Guo, Zhi Zhu, Shunsuke Kidani, and Masashi Unoki, “Contribution of Common Modulation Spectral Features to Vocal-Emotion Recognition of Noise-Vocoded Speech in Noisy Reverberant Environments,” Applied Sciences, 12(19), 9979, 2022. PDF
  https://doi.org/10.3390/app12199979

• Zhi Zhu, Miho Kawamura, and Masashi Unoki, “Study on the perception of nonlinguistic information of noise-vocoded speech under noise and/or reverberation conditions,” Acoustical Science and Technology, Vol. 43, No. 6, pp. 306-315, 2022. PDF
  https://doi.org/10.1250/ast.43.306

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “Contribution of modulation spectral features on the perception of vocal-emotion using noise-vocoded speech,” Acoustical Science and Technology, Vol. 39, No. 6, pp. 379-386, 2018. PDF
  https://doi.org/10.1250/ast.39.379

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “Contributions of Temporal Cue on the Perception of Speaker Individuality and Vocal Emotion for Noise-vocoded Speech,” Acoustical Science and Technology, Vol. 39, No. 3, pp. 234-242, 2018. PDF
  https://doi.org/10.1250/ast.39.234

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “Study on linguistic information and speaker individuality contained in temporal envelope of speech,” Acoustical Science and Technology, Vol. 37, No. 5, pp. 258-261, 2016. PDF
  https://doi.org/10.1250/ast.37.258

• Zhi Zhu, Katsuhiko Yamamoto, Masashi Unoki, and Naofumi Aoki, “Study on Scramble Method for Speech Signal by Using Random-Bit Shift of Quantization,” Journal of Signal Processing, Vol. 18, No. 6, pp. 303-307, 2014. PDF
  https://doi.org/10.2299/jsp.18.303

• Katsuhiko Yamamoto, Zhi Zhu, Masashi Unoki, and Naofumi Aoki, “Study on Semi-scramble Method for Speech Signals Based on Phonemic Restoration,” Journal of Signal Processing, Vol. 18, No. 4, pp. 205-208, 2014. PDF
  https://doi.org/10.2299/jsp.18.205

International Conference

• Zhi Zhu, and Yoshinao Sato, “Speech Emotion Recognition Using Semi-Supervised Learning with Efficient Labeling Strategies,” IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), 2021. PDF
  https://doi.org/10.1109/ASRU51503.2021.9687938

• Zhi Zhu, and Yoshinao Sato, “Reconciliation of Multiple Corpora for Speech Emotion Recognition by Multiple Classifiers with an Adversarial Corpus Discriminator,” INTERSPEECH 2020, pp. 2342-2346, 2020. PDF
  https://doi.org/10.21437/Interspeech.2020-1618

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “Study on the relationship between modulation spectral features and the perception of vocal emotion with noise-vocoded speech,” 176th Meeting Acoustical Society of America, The Journal of the Acoustical Society of America Vol. 144, pp. 1804, Vicoria, Canada, November 6, 2018.
  https://doi.org/10.1121/1.5067964

• Zhichao Peng, Zhi Zhu, Masashi Unoki, Jianwu Dang, and Masato Akagi, “Auditory-inspired end-to-end speech emotion recognition using 3d convolutional recurrent neural networks based on spectral-temporal modulation,” IEEE International Conference on Multimedia and Expo (ICME), 2018. PDF
  https://doi.org/10.1109/ICME.2018.8486564

• Zhichao Peng, Zhi Zhu, Masashi Unoki, Jianwu Dang, and Masato Akagi, “Speech emotion recognition using MPCRNN based on Gammatone auditory filterbank,” Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2017 (APSIPA 2017), pp. 1750-1755, Kuala Lumpur, Malaysia, December 15, 2017. PDF
  https://doi.org/10.1109/APSIPA.2017.8282316

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “Study on the relationship between modulation spectral features and the perception of nonlinguistic information with noise-vocoded speech,” The New Zealand/Japan Joint Research Meeting on Psychological & Physiological Acoustics and Electroacoustic, Proc. Auditory Research Meeting, The Acoustical Society of Japan, Vol. 47, No. 8, pp. 89-94, Auckland, New Zealand, December 1, 2017. PDF

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “Feasibility of Vocal Emotion Conversion on Modulation Spectrogram for Simulated Cochlear Implants,” 25th European Signal Processing Conference (EUSIPCO2017), pp. 1884-1888, Kos, Greece, August 31, 2017. PDF
  https://doi.org/10.23919/EUSIPCO.2017.8081526

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “Important role of temporal cues in speaker identification for simulated cochlear implants,” Proc. of the 1st International Workshop on Challenges in Hearing Assistive Technology (CHAT-2017), pp. 51-55, Stockholm, Sweden, August 19, 2017. PDF

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “The role of spectral and temporal cues for vocal emotion recognition by cochlear implant simulations,” Acoustics’ 17, Journal of Acoustic Society of America, Vol. 141, No. 5, Pt. 2, pp. 3816, Boston, USA, June 28, 2017. https://doi.org/10.1121/1.4988445

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “Recognition of Vocal Emotion in Noise-vocoded Speech by Normal Hearing and Cochlear Implant Listeners,” 5th Joint Meeting Acoustical Society of America and Acoustical Society of Japan, Journal of Acoustic Society of America, Vol. 140, No. 4, Pt. 2, pp. 3271, Hawaii, USA, December 1, 2016. https://doi.org/10.1121/1.4970384

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “Modulation spectral features for predicting vocal emotion recognition by simulated cochlear implants,” INTERSPEECH 2016, pp. 262-266, San Francisco, USA, September 9, 2016. PDF
  https://doi.org/10.21437/Interspeech.2016-737

• Zhi Zhu, Ryota Miyauchi, and Masashi Unoki, “Analysis of Modulation-Spectral Features Extracted from Japanese Emotional Speech,” The Taiwan/Japan Joint Research Meeting on Psychological & Physiological Acoustics and Electroacoustics, Proc. Auditory Research Meeting, The Acoustical Society of Japan, Vol. 45, No. 7, pp. 589-594, Hsinchu, Taiwan, October 23, 2015.

• Zhi Zhu, Ryota Miyauchi, and Masashi Unoki, “Analysis of Speaker Individual Differences on Modulation Spectrum,” 2015 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP15), pp. 17-20, Kuala Lumpur, Malaysia, February 28, 2015.

• Zhi Zhu, Katsuhiko Yamamoto, Masashi Unoki, and Naofumi Aoki, “Study on scramble method for speech signal by using random-bit shift of quantization,” 2014 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP14), pp. 109-112, Hawaii, USA, March 1, 2014.

• Katsuhiko Yamamoto, Zhi Zhu, Masashi Unoki, and Naofumi Aoki, “Study on semi-scramble method for speech signals based on phonemic restoration,” 2014 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP14), pp. 201-204, Hawaii, USA, March 1, 2014.

Other

• 朱治，関谷伸一，鵜木祐史，”残響が雑音駆動音声の個人性・感情知覚に与える影響の検討，” 2018年日本音響学会春季研究発表会，埼玉，2018．

• 関谷伸一，朱治，鵜木祐史，”雑音駆動音声の言語・非言語知覚と室内音響特性による影響の検討，” 信学技報，Vol. 117，No. 255，pp. 41-46，富山，2017年10月21日．

• 朱治，宮内良太，荒木友希子，鵜木祐史，”雑音駆動音声の個人性知覚に寄与する変調周波数成分の検討，” 2017年日本音響学会秋季研究発表会，pp. 359-362，愛媛，2017年9月27日．

• 朱治，宮内良太，荒木友希子，鵜木祐史，”変調周波数帯域の制御が雑音駆動音声の感情知覚に与える影響の検討，” 2017年日本音響学会春季研究発表会，pp. 1491-1494，神奈川，2017年3月17日．

• X. Li, Zhi Zhu, and Masato Akagi, “Acoustic feature selection for improving estimation of emotions using a three layer model,”2017 Spring Meeting of Acoustical Society of Japan, pp. 117-120, Kanagawa, March 15, 2017.

• Zhi Zhu, Ryota Miyauchi, Yukiko Araki, and Masashi Unoki, “Effect of modifying modulation spectrogram on vocal emotion perception for noise-vocoded speech,” Proc. Auditory Research Meeting, The Acoustical Society of Japan, Vol. 46, No. 9, pp. 571-576, Fukuoka, December 17, 2016.

• 朱治，宮内良太，荒木友希子，鵜木祐史，”雑音駆動音声の感情知覚と振幅包絡線情報の関係に関する検討，” 日本音響学会聴覚研究会資料，Vol. 46，No. 2，pp. 73-76, 福岡，2016年3月4日.

• 朱治，宮内良太，荒木友希子，鵜木祐史，”変調フィルタバンクを用いた感情音声における変調スペクトルの特徴解析，” 2016年日本音響学会春季研究発表会，pp. 507-510，神奈川，2016年3月9日．

• 朱治，宮内良太，鵜木祐史，”雑音駆動音声の個人性知覚に関する基礎的検討，” 平成27年度電気関係学会北陸支部連合大会，石川，2015年9月12日.

• 朱治，宮内良太，鵜木祐史，”変調スペクトルの帯域を制限した雑音駆動音声の個人性知覚に関する研究，” 2015年日本音響学会春季研究発表会，pp. 491-494，東京，2015年3月17日．

• 朱治，宮内良太，鵜木祐史，”音声の変調スペクトルに現れる個人差の分析，”日本音響学会聴覚研究会資料，Vol. 44，No. 7，pp. 457-460, 和歌山，2014年10月23日.

• 朱治，山本克彦，鵜木祐史，青木直史，”量子化ビットのランダムシフトを利用した音声スクランブル法，” 信学技報，EMM2013-109，Vol. 113，No. 480，pp. 57-62，石川，2014年3月7日．

• 山本克彦，朱治，鵜木祐史，青木直史，”音韻修復現象に着目した半開示音声スクランブル法の検討，”信学技報，EMM2013-78，Vol. 113，No. 291，pp. 59-64，広島，2013年11月15日．

• 朱治，山本克彦，鵜木祐史，青木直史，”量子化ビットのランダムシフトによる音声スクランブル法の検討，” 平成25年度電気関係学会北陸支部連合大会，石川，2013年9月21日.

• 山本克彦，朱治，鵜木祐史，青木直史，”音韻修復現象に着目した音声半開示スクランブル法の検討，” 平成25年度電気関係学会北陸支部連合大会，石川，2013年9月21日.