Tuesday, March 15, 2011

Learning Technology Selection: A Systematic Approach to Authoring Tools

Learning Technology Need:
A State Government Department Division seeks to systematically analyze the purchase of authoring tools for the employee training department.  Currently, the training department uses Ready Go authoring tool and needs something more robust to streamline the workflow. Authoring tool features that support more video, allow for more interaction, and have simulation and testing capabilities are highly desired.

Goals and Objectives of Technology Implementation:

Goal:  Recommend an authoring tool that can work within the State Department Division parameters and produce the type of training that increases overall efficiency in workplace training for government employees.

Objectives:

·         Identify a robust authoring tool that can work within the State Department Division parameters, such as SCORM compliance and a $1500 (approximate) budget
·         Assess technology implementations that increase training efficiency of government employees within the State Department Division 
·         Evaluate an authoring tool that can support more video, allow for more interaction, and has simulation and testing capabilities versus the limited authoring functions currently available with ReadyGo.

Use Cases:

Interviews with State Department Division employees engaged dialogue of the potential uses for a side by side comparison of appropriate matches.   The following is a list of possible uses and related selection criteria based on the information discovered in these discussions.

Criteria for use cases were identified directly from interviews, questionnaires and internet research in addition to suggested guidelines for selecting learning technologies in the Brandon Hall “How to Buy E-Learning Systems, Tools, and Services” and eLearning Guild’s “Synchronous Learning Systems” reports.

Use Case
Criteria
(Consider Technology, Design, Development and Learner Needs)
Three instructional training designers will be creating content for the State Department Division. The technical ability of the developers vary from novice to a firm grasp of basic HTML and Java script.
·         Built-in performance data tracking capabilities
·         Ability to repurpose content quickly from other sources, such as PowerPoint, Word, and specialty authoring tools (i.e. simulation tools)
·         Robust testing engine (with features such as randomization, drawing from a test item pool, etc.)
·         Minimal time spent creating navigational control structures (i.e. navigation buttons, menus, etc.) Products that don’t require you to create simulations at the “stick” level
·         Novice friendly, yet still has underlying extensibility
·         Varying levels of feedback, controlled through a control panel interface.
·         HTML code authoring capacity
·         Javascript authoring capacity
·         Extensive library of very interactive question types (beyond multiple choice and true false)
·         A variety of different testing modes
·         Test answers and data must easily upload to ACCESS Database for evaluation
·         Excellent product support
·         Product should not be too difficult to learn
Product training available at low cost/no cost
Content requires learners to be engaged in skill-based scenarios that apply in a real-world setting (pc simulations only) such as showing an employee how to administer a shot.
·         Role play scenario  for realistic modeling of simulated environments
·         Simulation capacity with demonstration mode
·         Simulation technology with guided practice and feedback
·         Varying levels of feedback, controlled through a control panel interface
·         Instructionally sound output, efficient playback over the internet, without requiring high-speed internet access
·         software applications for realistic modeling of simulated environments
·         Ability to repurpose content quickly from other sources, such as PowerPoint, Word, and specialty authoring tools (i.e. simulation tools)
·         ability to easily embed other media (.mp3 audio, .swf and .mpg video) into the course
·         Minimal time spent creating navigational control structures (i.e. navigation buttons, menus, etc.) Products that don’t require you to create simulations at the “stick” level
·         Novice friendly, yet still has underlying extensibility for complex interaction types.
Full compatibility with the Government Division's IBM Lotus LMS Web page sharing / tour in application

Create a soft skill simulation for new supervisors showing the long-term impact on a work unit of a manager's action/inaction when faced with particular behaviors among employees.
·         Software applications for realistic modeling of simulated environments
·         Built-in performance data tracking capabilities
·         Minimal time spent creating navigational control structures (i.e. navigation buttons, menus, etc.) Products that don’t require you to create simulations at the “stick” level
·         Novice friendly, yet still has underlying extensibility for complex interaction types
·         Instructionally sound output, efficient playback over the internet, without requiring high-speed internet access
·         Varying levels of feedback, controlled through a control panel interface
·         HTML code authoring capacity
·         Java script authoring capacity
·         Realistic, work-related stories using multimedia, flash, and text
·         Role play scenario for realistic modeling of simulated environments
·         Simulation capacity with demonstration mode
·         Simulation technology with guided practice and feedback
·         Extensive library of very interactive question types
·         ability to easily embed other media (.mp3 audio, .swf and .mpg video) into the course
Create tests that involve graphic hot-spots, clicking and dragging components on a screen or other more kinesthetic options. 
·         Evaluate authoring tools that involve graphic hot spots
·         Click and drag components on a screen
·         Consider other kinesthetic options
·         A variety of testing modes
·         An extensive library of interactive question types
·         Simulation capacity with demonstration mode
·         Test answers and data must easily upload to access database for evaluation
·         Authoring tool with evaluation options is a want but not a must
·         Built-in performance data tracking capabilities 
·         Section 508 compliant testing modes
·         Ability to repurpose content quickly from other sources, such as PowerPoint, Word, and specialty simulation tools
·         Robust testing engine (with features such as randomization, drawing from a test item pool, etc.)
·         Novice friendly, yet still has underlying extensibility
·         Instructionally sound output, efficient playback over the internet, without requiring high-speed internet access
State would like to see what testing formats leading tools provide
Develop a hard skill simulation walking participants through the steps of creating a chart in Excel for testing.
·         Built-in performance data tracking capabilities
·         Ability to repurpose content quickly from other sources, such as PowerPoint, Word, and specialty authoring tools (i.e. simulation tools)
·         Minimal time spent creating navigational control structures (i.e. navigation buttons, menus, etc.) Products that don’t require you to create simulations at the “stick” level
·         Novice friendly, yet still has underlying extensibility for complex interaction types
·         Instructionally sound output, efficient playback over the internet, without requiring high-speed internet access
·         Varying levels of feedback, controlled through a control panel interface
·         Full compatibility with the Government Division's LMS
·         HTML and Java script authoring capacity
·         Simulation capacity with demonstration mode
·         Simulation technology with guided practice and feedback
·         A variety of different testing modes
·         Test answers and data must easily upload to ACCESS Database for evaluation
·         ability to easily embed other media (.mp3 audio, .swf and .mpg video) into the course
Evaluation:

Six leading authoring tools were evaluated for consideration. The following tools identified were evaluated directly from interviews, questionnaires and internet research and industry reports using a combination of:

·         Product web sites
·         User discussion forums
·         Direct contact with product reps
·         Internet Research
·         Classroom Instruction

Performance ratings were determined by a combination of criteria provided through the sources listed above.

Authoring Tools were evaluated based on thirteen mandatory criteria that were essential product features for purchase consideration.

·        Compatibility with the Government Division's Learning Management System
·        Security/ facilitator firewall access requirements
·        Web based training capacity
·        Novice friendly with extensibility for more complex interactions
·        HTML code authoring capacity
·        JavaScript authoring capacity
·        Realistically simulation capabilities using multimedia, flash, and text
·        Computer simulations engaged in real-world skill-based  scenarios
·        Realistic simulations with role play capabilities
·        Demonstration mode
·        Guided practice and feedback
·        Extensive library of interactive question types
·        Data uploaded to ACCESS database for evaluation

Of the six products, one was removed because it was not a development platform (articulate).  Three of the remaining five were eliminated based on the MUST criteria for product purchase.  Criteria elimination breakdown is as follows:

·         Tools were significantly over budget – (SumTotal, and SimWriter)
·         No additional testing modes besides multiple choice (Apixel Metamorphosis)
·         Zero coding capacity (Apixel Metamorphosis)
·         Inexperienced with government systems and state LMS (SimWriter)

Only two remaining products were evaluated, even though they also were over budget.  Lectora, although significantly over priced, is willing to work with the State Department Division and steer them to possible additional funding opportunities. 
Adobe Captivate has three different government discount programs and may qualify for additional discounts.

Recommendations:

It is recommended that Lectora would be worth further investigation since the features were better overall.  The rep seemed confident that he would be able to help the state find funding and stated that Lectora is currently working with many government contracts.

If the state prefers not to go that direction, they may be able to purchase two licenses through Adobe Captivate and rearrange the duties of the three trainers. 

The third option would be to consider open source authoring tools.  Tools should be evaluated and researched in a separate report.

Top Picks:
#1 Lectora, Trivantis Corporation
311 Elm Street
Cincinnati, OH 45202 
(513) 852-7902
Contact: John Woods

#2 Adobe Captivate
345 Park Avenue
San Jose, CA 95110-2704
1-800-585-0774
1 408-536-6000

Open source authoring tools:


The steps for further review and selection of an authoring tool include:

1.   Identify an internal review team that includes the staff of instructional designers, a technologist, and administrator.  The administrator should select an appropriate subordinate to chair the review group. 
2.   The chair delegates trial accounts to each of the members.
3.   The administrator audits the initial analysis and notes each team member’s progress, every step forward. 
4.   The team determines whether open source authoring tools would be a consideration.
5.   The list of evaluation criteria is reviewed and changes are determined.
6.   Potential vendors provide clients with evaluation criteria and trial accounts, (for multiple licenses, requests for demonstrations, bids, and client references are common).
7.   Contact Lectora Representative to determine how he can help the State Department Division find funds (such as through the Center for Disease Control).
8.   Contact an Adobe representative to determine eligibility through government discount programs.



    No comments:

    Post a Comment