Turning an Exam into a “Game”

Here is an interesting example of using an immersive 3D learning environment to provide a realistic training experience and an unusual examination process. Below are some highlights from a case study sent to me by Caspian Learning, the makers of the 3D simulation software, Thinking Worlds. Its pretty fascinating and ground breaking use of 3D for testing in the energy industry.

The challenges below are not unlike the field test challenges in other industries and I can see a lot of use in other field test environments.

Energy efficiency certification requires an understanding of a complex safety issue, Combustion Analysis, which is challenging to teach and test because of the wide number of variables that could affect an outcome in each scenario. To try and ‘simulate’ this amount of complexity with real field training is expensive and prohibitive; but the training is essential and must be carried out. As the industry moves to scale, this skill set will become the cornerstone of safety standards and a longer term solution is vital.

Though a written test for combustion safety is fairly standard to administer, the field test is challenging for a number of reasons. It is expensive due to the fact that an experienced field proctor must administer the test in a ‘volunteer’ home. The field proctor usually charges approximately $100/hour and the test can take up to 2-3 hours. In addition, the volunteer home is often logistically difficult to manage and some of the training companies that offer the testing have resorted to buying homes and setting them up as test homes.

Interplay Energy in partnership with the Residential Energy Services Network (RESNET) saw that a simulation could mimic the goal of applied knowledge and understanding at the heart of the field test, while ensuring consistency and testing control across the numerous training/testing companies.

Here is a brief video of the interface and environment.

Additionally, a simulation would substantially reduce costs because an expensive field proctor would no longer be required.

Caspian Learning designed the simulation so that it would take approximately 1 hour to complete and would take place in a 2 story home. The test conditions were linked into an administrative control panel and could be set differently prior to each test to keep test takers actively engaged.

Within this framework for learning, it was a requirement that a number of key sub-topics or objectives were included:
1. Gas line leak detection
2. Ambient CO testing
3. Unvented appliance testing (ovens and stove top burners primarily)
4. Proper equipment usage
5. Appliance identification
6. Combustion appliance Zone (CAZ) understanding
7. Worst Case Depressurization
8. Vented Appliance (furnace, boilers, water heaters) tests: spillage, CO, draft

Each of these sub-topics was transformed into small short ‘lessons’ within the simulation that would be used for training purposes before students applied to take the final RESNET test simulation.
 
Due to the disparate locations of test centres and companies in the US running the certification tests, there was a vital need to bring a consistent, standardised certification test to all states across the US in the most accessible manner possible. Several deployment methods were made available;

1. The finished simulation was downloadable and able to be played on standalone, individual PCs
2. The finished simulation could also be deployed as a web-based simulation that could be played from any PC with an internet connection.

For both methods, results were able to be recorded centrally.

Having this level of standardization and consistency in combustion safety analysis certification tests will introduce a positive, disruptive new approach for home energy efficiency companies to interact with and train students.
 

Interesting use of 3D for realistic testing, a good use of the technology and a great way to simulate interactions within an actual field environment.

Check out other Thinking Worlds Case Studies here.