Sixth Annual MSET Workshop - October 6, 2000 San Juan, PR
The Sixth Annual Workshop for MSET-2001 was held at the Caribe Hilton in San Juan , Puerto Rico on Friday, October 6, 2000. Nineteen representatives from eight MIE institutions (Bowie State University, Oglala Lakota College, Sisseton-Wahpeton Community College, Sitting Bull College, Spelman College, The University of Texas at El Paso, Universidad Metropolitana, and Xavier University of Louisiana) and Systemic Research, Inc.
Dr. Jason Kim of Systemic Research welcomed the participants and outlined the day's activities. This year's workshop focused on the MIE Self-Evaluation Template (MSET) -2001A (quantitative database) and MSET-B (qualitative database) along with the Automated Data Collection System (ADCS). Two electronic survey methods were also introduced: OMR Scan Form method and Web-based survey. There was also an opportunity for representatives from each site to make a short presentation on their own experiences and concerns with MSET.
Dr. Kim began the workshop with a short quiz on key indicator data, i.e. total number of MIE students, number of SEM degrees earned, retention rates and faculty to student ratios. The answers were found in MIE Fact Book 2000 and Dr. Kim highlighted key indicators by reviewing several pages from Fact Book 2000 Volume 1 (Year 5 Overall Progress Report). The Fact Book is available in hard copy, CD-ROM (distributed to workshop participants) and on the Web (www.systemic.com/mie).
Dr. Hunhee Lee, Systemic Research, explained in detail MSET-2001A. MSET-2001A is a quantitative electronic data collection system customized for each MIE institution. Dr. Lee explained how the program works and demonstrated several examples. New this year is electronic submission capability. Each site can easily submit their completed MSET-2001A file through our web site using their user ID and password. This submission system was demonstrated.
With the assistance of Miss Elena Wilson of Sisseton-Wahpeton Community College, Dr. Lee led the participants in the installation of MSET-2001A in their laptop computers from the CD-ROM that had been distributed earlier in the workshop. The participants found the program to be easily installed.
Dr. Lee then described the Automated Data Collection System (ADCS). ADCS is now available in two versions; the Access version that has been used for several years and a new EXCEL version. ADCS is used to track activity, professional development and financial aid data. The resultant summary reports from the Access version can be used to easily complete the corresponding MSET-2001A input tables. The Excel version is especially appropriate for those intuitions that do not have a great number of activities to report. The completed template can be sent to Systemic Research who will transfer the data to MSET-2001A.
Mrs. Linda Crasco of Systemic Research presented MSET-2001B. MSET-2001B is the qualitative database available on Systemic Research Inc.'s web site. It is identical to previous year's versions. Users can easily access their database via a username and password. The template consists of 35 questions mirroring the ten sections MSET-2001A. The questions do not have to be answered during one working session. The procedures to input data into the web database were demonstrated and some of the questions were discussed. Examples were given of how the data from MSET-2001B is used in the MIE Fact Books.
After lunch hosted by Systemic Research, Mrs. Crasco demonstrated two different electronic survey methods. Electronic surveys may be used in the MIE program in many different situations, i.e. program evaluation, teacher/course evaluation and post graduate/Alumni surveys. The response was extremely positive.
The software used for the sample OMR scan form was Remark Office OMR®. Remark is not the only software available; it was selected because of availability, ease of use and relativity low cost. The procedures for creating and compiling data from completed surveys were outlined. Details were given of the "rules" for designing a survey form (in any software program), and the procedures for scanning in the template and defining the three available types of OMR fields- OMR, bar code, and image. The analysis reports produced by the OMR software were reviewed.
A short demonstration using the actual Remark software and the workshop evaluation form was given. Dr. Keri Burton-Danner of Spelman College volunteered to show the participants how to define the fields in the evaluation survey form.
The second survey technique explored was a web-based survey. In our example FrontPage® was selected to be used as our example. There are numerous web publishing software packages available, and the web-based surveys may also be designed using a computer language such as HTML or java script. The software and hardware requirements and actions necessary to design a web-based survey were briefly discussed. The procedure for designing a web-based form was demonstrated using Front Page. The participants were informed that detailed technical assistance in building a web-based survey form was available from Systemic Research by request.
The late afternoon session was designed to give the participants an opportunity to discuss their experiences and concerns with MSET.
Mr. Stacy Phelps of Oglala Lakota College was enthusiastic in his praise for the use of MSET in his institution. Before MSET was implemented, data had to be compiled by hand which was time consuming and led to data discrepancies. MSET was the start of the first comprehensive MIE data collection effort at Oglala. It allowed his institution to identify their needs and visualize the areas that needed improvement. The MSET data has also been used when preparing grant proposals.
The major goal, and challenge, for the Oyate Consortium (Oglala Lakota College, Sisseton-Wahpeton Community College, and Sitting Bull College, Sinte Gleske University, and Si Tanka College) is to compile their data together to present the MIE program as a whole. It is difficult to show progress by each school individually due to small enrollment numbers. Since the schools are geographically located at great distances from each other they are particularly interested in web-based data collection. Due to the unique nature of the Oyate Consortium, and their desire to improve their data collection system, Systemic Research will make a visit to provide on-site technical assistance in the near future.
Mr. Earl Mitchell of Xavier University expressed some concerns regarding MSET data collection. He stated his major difficulty has been in collecting data from the various departments on campus. He conveyed that he encounters resistance from some of the departments who request explanations of how providing the data is helpful to the MIE program. Mr. Mitchell also raised some questions concerning definitions of the terms used in the MSET data collection tables, i.e. outreach, collaboration with community etc. The ensuing discussion of terms ended with the suggestion that Systemic Research provide a list of definitions to the institutions.
Mrs. Ann Darnell of the University of Texas at El Paso shared with the workshop participants a presentation she made at UTEP's Advisory Meeting PIs entitled MSET: Relevant Developments and Concerns. UTEP's SEM student's retention rate from 1997-98 to 1999-00 was illustrated and compared to that of the institution as a whole. She also discussed the fact that the MIE program at UTEP has changed over the years since its inception, but the MSET data requests have not. The relevant concerns of MSET at UTEP are outlined below:
The workshop concluded with a general discussion of MSET and its implications at each MIE institution. The general consensus was that the annual workshop is an ideal opportunity to not only review the data collection instruments, and new technologies, but to share experiences and learn from each other. The evaluation results indicate that all participants were extremely satisfied with the workshop.