Wednesday, March 10, 2010

The player's physical experience

I apologize that this week’s posting was a bit delayed. I became somewhat busy with a new position. Check out for details.

We have been wandering through the 5-6 key constructs for secure natural communications. One of my key objectives is to enumerate research areas that require more effort to achieve our goal. Comments are invited on current status and research progress.

If the player’s semantic experience is one of higher-level semantics of unlimited breadth, the physical experience deals with a more specific set of modes of physical interaction that a user might have with the infrastructure. For each mode, the challenge is the same. The player has some means of physically expressing themselves. What is most “natural” depends on the player and depends on the application. But in any case, there are only a limited number of methods that are used.

Research problems related to the player’s physical experience

Sensors. To obtain a greater degree of naturalness there will be many core sensors in the infrastructure. These will range from traffic sensors on highways to cameras to speech sensitive devices. Research is required to improve the cost, shrink the size, and blend into the environment.
Enabling everything for secure natural communications. Further reductions in costs for RFID’s and GPS will include more items in the intelligent network and have their location trackable.
Speech sensors. An important set of sensors. Microphones are available as part of the infrastructure so that people’s speech can be the primary input device of their intentions. Improved noise and echo cancellation for the overall system is required.
Wearables. A key design point for small sensors; particularly speech capture is a wearable sensor. This requires research in nanotechnology to better embed this capability into garments.
Video, gesture capture. This will enable a richer interpretation of the user’s intent, and a richer understanding of what is going on at target locations.
Other methods. These would include different forms of keyboard, signing (for speech impaired), etc.


  1. Congratulations!

    I do not know how relevant these questions are:
    1) The current infrastructure consists of "Circuit Switching and Packet Switching Networks ". There will be problems when the user is on different set of networks. Will the infrastructure be handling all this? Do we need some standardization here?
    2) Do you see the potential in technologies like mobile ad-hoc wireless networks or Vehicular ad-hoc networks in the part of intelligent infrastructure?

    Some things you may want to look at:
    1) ( --> Smarter Planet Blog.
    2) ( --> Google Tech Talk by Prof. Martin Vetterli on Sensor networks. ( Applications in environmental monitoring, like for example tomographic measurements, and a description of a large scale environmental monitoring project in the Swiss Alps. This project, called SensorScope). May not be very relevant, but it will give some issues like : "The interaction of distributed source compression and transmission, with a particular focus on joint source-channel coding."

  2. Chiku,

    Thanks as always for your comments.

    Here are my thoughts.

    1. On core infrastructure - I think we are converging to a packet infrastructure over time.

    2. Yes, mobile ad hoc and vehicular are important. Here I was focused predominantly on the physical interface not the communications infrastructure behind that. I have a module coming later on the core infrastructure - where we will get into mobile ad hoc and vehicular.

    Thanks for the pointers.