登录 EN

添加临时用户

“以声塑形”的视觉表现研究

Shape with Sound: Study on Visual Representation of Sound Visualization

作者:赵雁南
  • 学号
    2019******
  • 学位
    硕士
  • 电子邮箱
    zha******com
  • 答辩日期
    2022.05.17
  • 导师
    陈磊
  • 学科名
    设计学
  • 页码
    60
  • 保密级别
    公开
  • 培养单位
    080 美术学院
  • 中文关键词
    声音视觉化,“以声塑形”,视觉表现
  • 英文关键词
    Sound Visualization,“Shape with Sound”, Visual Representation

摘要

数字时代下,互联网技术已然推动跨媒介传播形态逐步成型,数字影像与数字声音共同包围了人们的日常生活,形成了视听交融的信息传达方式。新媒体为视觉文化提供了多元化的传播环境,令影像更具文化与商业的双重价值,带动视觉感官为主导的认知习惯,人们开始追问从影像空间中“看见”声音的可行方法。随着计算机技术与视听联觉的研究进展,以数字媒介为载体、跨越众多交叉学科的声音视觉化手段应运而生,并催生出一系列“以声塑形”的跨媒介叙事方式。后疫情时代的降临,催化了线上视听模式的快速变迁,部分视听场景从冰封期中暂时苏醒,开始利用流媒体技术、互联网传播渠道向线上转移。随着近年来线上实践经验的充实,线上时域信号延迟、现场感缺失等弊端一一显露,用户对视听内容品质和体验新颖度都提出了更高诉求。“以声塑形”的艺术形态开始重新引发关注,人们运用声音视觉化的实现手段在数字虚拟时空进行视觉表现、构建多感官共鸣。“以声塑形”的跨媒介叙事方式,能够为视听艺术提供整合化的创作体系,拓展表演与展览的呈现形式,在后疫情时代显现出实际应用与设计美学兼具的价值倾向。故此,“以声塑形”的艺术形态不但需要在技术层面解决实现方法的问题,而且在美学研究层面,如何令视觉语言符合受众的跨感官体验、权衡风格个性化和语义传达的最优解,也是声音视觉化研究领域亟需探讨的问题之一。本文主要从以下方面展开“以声塑形”的视觉表现研究:其一,借助视听联觉理论,在前人研究基础上探究视听感官的互补关系,梳理声音与影像的时空对位法则;其二,通过总结“以声塑形”中视听的特点,为后疫情时代广泛运用的数字场景提供情境交融的可复用框架,使形式风格匹配于具体情境;其三,声音视觉化领域自身需要摆脱过度强调技术、视觉呈现单一的同质化现状,通过呼吸声和艺术声音的介入,研究“以声塑形”的三维视觉语言创新,在美学理论方向有所突破。本课题融合声学、设计学、心理学、计算机科学多学科视角,以声形要素之间的时空对位方法为主要研究线索,以影像质料与影像符号在数字虚拟空间的应用为研究目的,致力于拓展“以声塑形”艺术形态的创作边界,为后疫情时代下的视听模式创新带来新的生机。

In the digital era, Internet technology has gradually promoted the formation of transmedia communication. Nowadays, digital images and digital sounds are surrounding our daily life, forming a new information transmission mode of audio-visual integration. Since new media provides a diverse visual communication environment, videos have enhanced dual value at cultural and commercial levels. As the perception habits of the human brain are dominated by vision, people begin to explore the feasible method of "seeing sound" through images. With the research progress of computer technology and audio-visual synesthesia, digital media and interdisciplinary approach innovate sound visualization method, which inspires a transmedia narrative mode of“shape with sound”.The advent of the post-epidemic era has fostered the rapid changes in online audio-visual mode. Part of the audio-visual scene has awakened during the frozen epidemic period and has been reborn online by streaming media. With the enrichment of online practical experience in recent years, drawbacks of the online mode such as signal delay and lack of presence have been revealed. Online users raise higher demands for content quality and audio-visual experience. Therefore, the art form of "shape with sound" starts to attract attention again. Sound-visualization methods are widely used for visual expression in digital virtual space to construct multisensory resonance.Nowadays, the transmedia narrative mode of "shape with sound" can provide an integrated creative system for audio-visual art, and expand the presentation forms of performances and exhibitions. In the post-epidemic era, sound visualization reveals both practical and aesthetic value orientation. Therefore, it’s not only necessary to solve the problem of the technical realization method, but also to balance visual individuation and synesthetic experience at the aesthetic level. The innovation of visual representation is also one of the urgent research directions in the field of sound visualization.In this paper, the research on the visual representation of "shaping with sound" is mainly carried out from the following aspects. First, this study uses the theory of audio-visual synesthesia to explore the relationship between audio-visual senses based on previous research and to sort out principles of space-time counterpoint between sound and image. Second, by analyzing the characteristics of audiovisual materials, the study summarizes the methodological framework of sound visualization, to ensure the form of sound visualization perfectly match the digital virtual scenes. Thirdly, the field of sound visualization itself needs to get rid of the over-emphasis on technology and the homogeneity of visual representation. Through the intervention of breathing sound and other artistic sounds, this paper studies the innovation of three-dimensional visual language of "shaping with sound", and makes a breakthrough in the direction of aesthetic theory. This subject integrates the multi-disciplinary perspectives of acoustics, design, psychology, and computer science, and takes the counterpoint method between sound and shape in time and space as a research thread. Finally, this research aims at the application of image materials and image symbols in digital virtual space and is committed to expanding the creative boundary of the "sound-shaping" art form, bringing new vitality to the innovation of audio-visual models in the post-epidemic era.