Course Number: IAT 204
Course Title: Encoding Media Practice
Credit Hours: 3 Vector: 2-0-3
Course Description
Introduction to new media programming techniques using a visual dataflow language suitable for the rapid prototyping of media systems. Programming techniques are explored within the task environment for various individual and integrated media such as music, speech, animation, 3D graphics and their performance. An approach to the performative aspects of programming is developed through a series of composition and design projects in software across media.
Prerequisite:
None.
Recommended: None.
Corequisite: None.
Special Instructions: None.
Course(s) to be dropped if this course is approved:
This is a required course in the Digital Media Environments stream dealing with programming theory and practice in interactive media and performance.
Will this be a required or elective course in the curriculum; probable enrolment when offered?
Indicate Semester and Year this course would be first offered and planned frequency of offering thereafter.
2004-3 and annually thereafter.
Which of your present CFL faculty have the expertise to offer this course? Will the course be taught by sessional or limited term faculty?
SIAT Faculty.
Are there any proposed student fees associated with this course other than tuition fees?
No.
Is this course considered a `duplicate' of any current or prior course under the University's duplicate course policy? Specify, as appropriate.
No.
Note: Senate has approved (S.93-11) that no new course should be approved by Senate until funding has been committed for necessary library materials. Each new course proposal must be accompanied by a library report and, if appropriate, confirmation that funding arrangements have been addressed.
Provide details on how existing instructional resources will be redistributed to accommodate this new course. For instance, will another course be eliminated or will the frequency of offering of other courses be reduced; are there changes in pedagogical style or class sizes that allow for this additional course offering.
The course is already supported by the resources at the Surrey campus.
Does the course require specialized space or equipment not readily available in the department or university, and if so, how will these resources be provided?
Space and equipment are already in place to support this course at the Surrey campus.
Does this course require computing resources (e.g. hardware, software, network wiring, use of computer laboratory space) and if so, describe how they will be provided.
This course requires the use of the existing networked Macintosh and/or PC labs with appropriate programming environments installed. Licenses for the MaxMSP/Jitter programming environment are already in place.
Topics:
data-flow & graphical programming introduction
aspects of spatial syntax in data-flow languages
interacting within the real-time programming environment
data types, events, variables, conditionals, constants, operators, data structures, user interface
time: measurement, rhythm, tempo, accent, phrasing, form
data structures for media capture, representation and performance
the interactive loop: sensing-processing-response
digital media representations: sample-waveform-pixel-frame-vector
encoding music practice: music representation, scores, generative techniques
encoding cinematic practice: film representation, montage, transitions, image compositing, sound-picture relations
encoding 3D space: OpenGL graphics, composition in 3-space, navigation, animation, texture mapping, physical models, sound in virtual space
This course introduces programming new media programming techniques using a visual dataflow language suitable for the rapid prototyping of media systems. Programming techniques are explored within the task environment for various individual and integrated media such as music, speech, animation, 3D graphics and their performance. An approach to the performative aspects of programming is developed through a series of composition and design projects in software across media.
Exercises in individual media:
Sound
Graphics
Final Project: Encoded Media Art project in MaxMSP/Jitter
Coursepack readings: essays in software art and new media theory and practice, cognitive musicology, machine models of art practice, drawn from the following:
Dobrian, C., Kit-Clayton, J., et al. 2004. MaxMSP/Jitter Documentation and Tutorials in Digital Audio, Graphics and OpenGL programming.
Laske, Otto E. 1992. The Humanities as Sciences of the Artificial Interface 21.3-4:239-255. Lisse.
Woo, M., Neider, J., and Davis, T. 1996. Open GL Programming Guide. Addison Wesley
Roads, Curtis. 1996. The Computer Music Tutorial. MIT Press.
Rowe, Robert. 2001. Machine Musicianship. MIT Press.
Woo, Mason, Neider, Jackie, et al. 1999. OpenGL Programming Guide – The Official Guide to Learning OpenGL. Addison-Wesley.
Cohen, Harold. various writings on encoding visual art, http://crca.ucsd.edu/~hcohen/
Reas, C., Fry, B. 2003. Processing (programming visual design) http://proce55ing.media.mit.edu/learning/index.html
Students will be required to provide written documentation of their projects with detailed accounts of the design process involved and in reference to the readings provided.