Audiovisual language in cinema and videogames - framing, rhythm and narrative structure

The audio-visual Language

Audio-visual language is formed through three other languages: verbal, sound, and visual. Its reach and impact on society are observed from entertainment to education, including films, series, commercials, classes, and video games. Its composition involves visual and sound elements such as framing, composition, lighting, color, camera movement, editing, soundtrack, among others. These elements are responsible for transmitting messages and evoking meanings.

An essential book on audiovisual language is “Grammar of the film language”, by Daniel Arijon. In the book, Arijon explores the basic principles of film language, providing an understanding of the visual and sound elements that compose the audiovisual language. The book covers topics such as framing, camera movement, rhythm, editing and visual effects, providing the basis for analyzing and creation.

Another book worth mentioning is “The 5 C’s of Cinematography”, by Joseph V. Mascelli. This book is a reference focused on audiovisual language, specifically in the field of cinematography and direction of photography. In the book, the author explores the five key elements that constitute the visual language in cinema: framing, camera, composition, cut (continuity) and backlight (contrast).

The audio-visual narrative

The audio-visual narrative presents the story in a structured way, using the resources of the audiovisual language. There are several narrative structures, and their use is related to the creativity of the production team, from the writers to the directors. It involves choosing characters, plot development, building narrative arcs, dialogue usage, editing rhythm, and the progression of events. The skill of storytelling is what keeps the audience engaged and emotionally connected to the work.

A very rich book on the subject is “Story: Substance, Structure, Style and the Principles of Screenwriting”, by Robert McKee. In this work, the author explores the fundamentals of screenwriting, addressing topics such as story design, character development, structures, genres, effective dialogue and the power of narrative twists.

Another commonly mentioned book is “The Writer’s Journey: Mythic Structure for Writers” by Christopher Vogler. The work is aimed primarily at writers, but is equally relevant to writers of audio-visual narratives. Vogler explores the mythic structure present in many narratives, inspired by Joseph Campbell’s theories, and shows how to apply it in the construction of impactful and engaging stories.

The audio-visual branches

The application of audio-visual language and narrative concepts is vast, and covers all branches of audio-visual production: Cinema, television, advertising, online videos, animation, documentaries, music videos, video art, educational, corporate, web-series, VR (virtual reality), AR (augmented reality), video games; and perhaps a few more that I don’t know about, or don’t remember right now.

Audio-visual language and narrative are interconnected disciplines, and complement each other in the creation of an audio-visual work. Mastering the audiovisual language and understanding the principles of narrative is essential to create a good audio-visual piece.

And that’s all for now. I hope you enjoyed these brief considerations. If you want to go deeper, check out the 3 pillars of visual narrative in filmmaking.