CS569 – Mobile and Ubiquitous Graphics

Instructor

Tolga K. Çapın

Phone

(312) 290 1218

Office

EA 431

E-mail

tcapin [at] bilkent.edu.tr

Class hours

Wednesdays, 8:40-10:30

Fridays, 10:40-11:30

Office Hours

Open door policy. Check my calendar at web site.

 

 

Schedule of Lectures and Assignments

 

 

 

 

Introduction

 

 

Week 1

Wed, Sep 17

Introduction to CS569

 

 

 

Fri, Sep 19

State of Art in Mobile Graphics

 

 

 

Mobile Platforms and Technology

 

Week 2

Wed, Sep 24

Real-Time Rendering Pipeline

RA1: Pulli05 out (due 8 Oct).

 

 

Fri, Sep 26

Mobile APIs; M3G

RA2: Möller08 out (due 15 Oct).

IA1 out: M3G programming (due Oct 15).

Akenine-Möller’s Assignment 1 page.

Week 3

Wed, Oct 1

Fri, Oct 3

Holidays, no class

Holidays, no class

 

 

 

 

 

Week 4

Wed, Oct 8

Fri, Oct 10

Traveling, no class

Traveling, no class

RA1 due

 

 

 

 

Week 5

Wed, Oct 15

Fri, Oct 17

Traveling, no class

Students present term project ideas

RA2 due

 

PR1 out: Project Proposal (due 27 Oct)

IA1 due: M3G programming

 

Week 6

 

Wed, Oct 22

Fri, Oct 24

 

Rasterization and Interpolation

Rasterization and Interpolation (cont.)

Using OpenGL ES 1.x

 

 

 

RA3: Möller03 out (due 31 Oct).

 

IA2 out: OpenGL ES Game (due 14 Nov)

PR1 due: Project Proposal

 

Week 7

Wed, Oct 29

Fri, Oct 31

Holidays, no class

Antialiasing

 

RA3 due

 

 

Week 8

Wed, Nov. 5

Fri, Nov 7

Texturing

Using OpenGL ES 2.x

 

 

 

 

 

 

 

Week 9

Wed, Nov. 12

Fri, Nov. 14

 

Texture and Buffer Compression

Culling

RA4:  Ström05 out (due 19 Nov)

 

 

 

 

Presentation Schedule:

 

 

 

 

Week 10

Wed, Nov. 19

Cihan, Adil

Transmission / streaming of 3D models to mobile devices

 

Fri, Nov. 21

Doğan, Can

Remote rendering

 

Week 11

Wed, Nov. 26

Denizhan, Mustafa

Multi-view rendering; visualization

 

Fri, Nov. 28

Zeynep, Abdullah

Mobile perception; depth perception, NPR

 

Week 12

Wed, Dec. 3

Duygu, Mehmet

Direct manipulation

 

Fri, Dec. 5

Yeliz, Bertan

3DUI and Mobile UI

 

Week 13

Wed, Dec. 10

---

---

 

Fri, Dec. 12

---

---

 

Week 14

Wed, Dec. 17

Sercan, Emre

Mobile Augmented Reality

 

 

 

 

 

 

Reading Assignments

·         RA1: Pulli05 – Kari Pulli, Tomi Aarnio, Kimmo Roimela, Jani Vaarala, "Designing Graphics Programming Interfaces for Mobile Devices," IEEE Computer Graphics and Applications ,vol. 25, no. 6,  pp. 66-75, November/December, 2005.

·         RA2: Möller08 – Tomas Akenine-Möller and Jacob Ström, Graphics Processing Units for Handhelds, Proceedings of the IEEE, special issue on Cutting-Edge Computing, vol. 96, no. 5, May 2008.

·         RA3: Möller03 Tomas Akenine-Möller and Jacob Ström, 2003. Graphics for the Masses: A Hardware Rasterization Architecture for Mobile Phones. ACM Transactions on Graphics, 22, 3, 801–808.

·         RA4: Ström05 Ström, J. and Akenine-Möller, T. 2005. iPACKMAN: high-quality, low-complexity texture compression for mobile phones. In Proceedings of the ACM SIGGRAPH/EUROGRAPHICS Conference on Graphics Hardware (Los Angeles, California, July 30 - 31, 2005). HWWS '05. ACM, New York, NY, 63-70.

 

 

 

Text:

Mobile 3D Graphics – with OpenGL ES and M3G, Pulli et. al, Morgan Kauffman, 2008 (required)

Additional journal and conference articles will be provided in class.

Description:

This course will teach current techniques in mobile and ubiquitous graphics. By the end of the course, students will:

·         understand the fundamental research problems in mobile and ubiquitous graphics

·         use mobile graphics techniques to develop mobile applications

·         read and critically evaluate the current literature in mobile graphics and ubiquitous computing

 

This course will introduce techniques such as mobile graphics hardware and software, low-level rendering techniques, scene graph management, remote rendering. The course will also explore state-of-the-art research topics in 3D user interfaces, 3D displays, mobile visualization, 3D model transmission, and gesture-based interaction.

Prerequisites:

There is no prerequisite for this course, but an undergraduate level course on computer graphics (CS465) and basic knowledge of OpenGL and computer human interaction techniques will be a big plus. Students are expected to be very comfortable with programming and graphics at the level of the undergraduate advanced course. Students taking the course must have in possession a programmable mobile device with a state-of-the-art GPU (graphics hardware) on it.

Grading:

 

Activity

Grade

Project

40%

Programming Assignments

30%

Reading Assignments

20%

Participation

10%

 

The largest contribution to the course grade will be a 10-week course project (40%). This includes selecting a topic, submitting a proposal, doing the actual work, writing a research paper, presenting the results, and creating a presentation based on the project. The project topic may be either a design of an original solution and implementation of a new research idea, or detailed evaluation and categorization of recent research publications.

 

Students will be given three medium-scale programming assignments and weekly reading assignments. Programming assignments will have to be implemented on a mobile device with a GPU, and require knowledge of OpenGL/C/C++.  Reading assignments require reading a recent research article and making critical evaluation of it.

Project Topics (Tentative):

The topics must relate to mobile graphics, and the topics discussed in class:

-          Mobile graphics architectures

-          Mobile graphics rendering and optimization techniques

-          Mobile user interfaces, interaction design and techniques, user-centered studies 

-          Camera-based or sensor-based user interaction

-          Streaming mobile multimedia

-          Mobile media management

-          Intelligent, aware, proactive, and attentive environments, perception and modeling of the environment

Students can also propose a project idea based on their research interests.

Submission Policy

Each assignment should be submitted electronically by email, before the beginning of the class on the day the assignment is due. If students don't submit homework on time, the following lateness policy applies.

Submission Policy

Each assignment should be submitted electronically, before the beginning of the class on the day the assignment is due. Students have 3 late days that they may use for any of the programs or project stage during the semester (except the final project presentations).

 

Readings

 

Recommended Articles

·         Tolga Capin, Kari Pulli, Tomas Akenine-Möller, The State of the Art in Mobile Graphics Research, IEEE Computer Graphics and Applications, Volume 28, Issue 4, pp. 74-84, Jul.-Aug. 2008.

·         Kari Pulli , New APIs for Mobile Graphics, SPIE Electronic Imaging 2006 Multimedia on Mobile Devices II, San Jose, USA, 2006.

 

Recommended Books

·         Shirley P. Fundamentals of Computer Graphics, Second Edition. AK Peters, 2005.

·         Sears, Jacko, The Human-Computer Interaction Handbook, CRC, 2008.

·         Akenine-Möller, Real-Time Rendering, Third Edition, 2008.

 

Journals/Magazines

·         IEEE Transactions on Visualization and Computer Graphics

·         IEEE Computer Graphics and Applications

·         Journal of Visualization and Computer Animation

 

Conferences

·         SIGGRRAPH

·         EUROGRAPHICS

·         IEEE CASA (Computer Animation and Social Agents)

·         ACM/Eurographics SCA (Symposium on Computer Animation)

·         ACM Conference on Human Factors in Computing Systems (CHI)

·         ACM Symposium on User Interface Software and Technology (UIST)