The SUNY Learning Network (SLN) online teaching self-assessment survey for experienced online faculty

Award Winner: 
2010 Sloan-C Effective Practice Award
Author Information
Author(s): 
Alexandra M. Pickett
Institution(s) or Organization(s) Where EP Occurred: 
SUNY Learning Network
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

The online teaching self-assessment survey for experienced online faculty turns theory into practice by assisting the experienced online instructors to self-assess on specific indicators of teaching presence from the COI model and the development of online class community in the design of their own online courses and how they teach them. Faculty are asked to self-assess on 20 specific indicators, the survey generates a report giving the instructor a numerical score for each indicator that corresponds to a key of score ranges. (See Appendix B (http://www.slideshare.net/alexandrapickett/teachingsurveyreport) for an example of this survey-generated report and the specific indicators isolated by the survey). The instructor can then see, based on his/her own self-evaluation, what specific areas in the online course need (1) redesign, (2) need some improvement, or (3) effectively demonstrate class community and teaching presence and need no improvement. A companion piece to the survey is a series of handouts that provide examples of the indicators, and suggestions that faculty can use to make improvements in those areas where their self-assessment indicated they needed some improvement: ( http://www.slideshare.net/alexandrapickett/sln-teaching-online-survey-course-review-materials ).

 

Description of the Effective Practice
Description of the Effective Practice: 

The SUNY Learning Network is committed to assisting SUNY campuses and faculty become highly effective online educators who understand online pedagogy/andragogy and best practices, can leverage the appropriate LMS tools and functionality available to meet specific learning objectives, and who can create and manage effectively designed online teaching and learning environments in which to teach and learn.

Every year SLN trains approximately 300 new fully online faculty.  Most of the faculty development efforts of the SLN program and the participating campus-based instructional designers target new online faculty development and course design. However, since 1994, we estimate that we have trained 3,000- 4,000 fully online faculty in the SUNY system to develop and teach effective online courses – that represents about 10% of all SUNY faculty. With this increasingly staggering number of “experienced” online SLN faculty (i.e., those that have participated once in the SLN new faculty development program and developed and delivered their first fully online course via SLN) we needed a way to continue to continue to inform and influence the quality of existing online courses and the ongoing professional development of the online faculty. The SLN faculty development approach defines online course design as an iterative process including a review and revision loop for the continuous improvement and evolution of the online course and the skills of the online instructor.  See Appendix A http://slnfacultyonline.ning.com/page/effective-practices. We developed the SLN experienced online instructor teaching self-assessment survey (http://SLNsuny.edu/teachingsurvey) as a mechanism to programmatically address that aspect of our model (Step 7/ Stage 4) and to specifically target the online course review and revision needs of this growing cadre of experienced online instructors in the SUNY Learning  Network. The SLN online teaching self-assessment survey for experienced online instructors was prototyped and piloted for the fall 2006 SLN online faculty development cycle.

Our research shows that high levels of "Teaching Presence" (Anderson, 2001) - effective instructional design and organization, facilitation of productive discourse and direct instruction -  positively and significantly influence the satisfaction and reported learning of online students. Our research also shows that thereis a positive and significant correlation between student satisfaction and faculty satisfaction.

There is also evidence to suggest that a strong sense of community in the classroom helps reduce student feelings of isolation and “burnout” associated with higher attrition levels in both classroom-based and distance learning. A positive sense of community also promotes the likelihood of student support and information flow, commitment to group goals, cooperation among members and satisfaction with group processes and efforts [e.g. Rovai (2002)]. 
We believe that thereis a relationship between teaching presence and the development of community in online learning environments - that courses characterized by effective teaching presence are more likely to develop a stronger sense of community on the part of students.

This self-assessment survey continues to be used today as the key element in our SLN returning faculty resources and events. It is used in our returning faculty instructional design institutes, as a stand alone self-assessment for faculty, and as a tool for campus-based online instructional designers to use with their online faculty. It is designed to branch questions to address the needs of both fully online and blended learning online instructors and their courses.

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

How can a faculty development process help faculty to engage in behaviors that are likely to result in productive learning environments, high levels of learning and student satisfaction? To achieve this goal we developed the SLN online teaching self-assessment survey for experienced online faculty. Courses characterized by effective teaching presence are more likely to develop a stronger sense of community on the part of the students resulting in high levels of faculty and student satisfaction and reported learning. Attention to the principles espoused by Bransford and colleagues [3], Chickering and Gamson [4], as well as Garrison and colleagues [6] and Anderson and colleagues [5] (and articulated in our conceptual framework) have proven to be an approach to ensure high quality in the development of online teaching and learning environments. We continue to facilitate understanding of this emerging conceptual framework (See Figure 1 below http://tiny.cc/5zm24) with the SLN community and to seek to improve the experiences of students and faculty in the SUNY Learning Network.

-Fall 2006 faculty satisfaction results:

90.4% satisfied with SLN program support and services.

88.5% would recommend teaching online to a colleague.

95.4% would like to teach online again.

81.6 % were very satisfied with teaching their online course.


-Fall 2006 student satisfaction results:

83.6% % satisfied with SLN program support and services.

85.9% would take another online course in the future.

80.6% were satisfied with their online course.

78.4% reported that they learned a great deal in their online course.

How does this practice relate to pillars?: 

A unique aspect of SLN’s approach to online faculty development and effective course design is its theoretical foundation in social constructivism, and in the Community of Inquiry (COI) model developed by Garrison, Anderson, and Archer http://communitiesofinquiry.com/model , and our own conceptual framework for high quality higher education online learning environments that merges the COI model with  principles espoused by Bransford and colleagues [3], Chickering and Gamson [4], and Anderson and colleagues [5]. Our ongoing contributions to and use of research and scholarly work to inform all aspects of our SLN faculty development and course design practices is a fundamental aspect of our program. It  is articulated consistently throughout the program in the professional development of the 50+ online instructional designers participating in the program, with both new and returning online faculty, and in the effective online teaching and learning practices recommended and online course templates used by all faculty to quick start their online course design process in the program. The online teaching self-assessment survey for experienced online faculty turns theory into practice by assisting the experienced online instructor’s to self-assess on specific indicators of teaching presence from the COI model and the development of online class community in the design of his/her own online course and how they teach it. Faculty are asked to self-assess on 20 specific indicators, the survey generates a report giving the instructor a numerical score for each indicator that corresponds to a key of range of scores. (See Appendix B http://www.slideshare.net/alexandrapickett/teachingsurveyreport for an example of this survey-generated report and the specific indicators isolated by the survey). The instructor can then see, based on his/her own self-evaluation, what specific areas in the online course need (1) redesign, (2) need some improvement, or (3) effectively demonstrate class community and teaching presence and need no improvement. A companion piece to the survey are the hand outs that provide examples of the indicators, and suggestions that faculty can use to make improvements in those areas where their self-assessment indicated they need some improvement See Appendix B http://www.slideshare.net/alexandrapickett/teachingsurveyreport . 

Equipment necessary to implement Effective Practice: 

This online faculty self-assessment is a simple survey - all you need is a web browser and an email address.

Estimate the probable costs associated with this practice: 

This online faculty self-assessment is a simple survey, the innovation lies in the report that it generates to the faculty that aids the experienced online instructor to identify areas in his/her course that they them selves feel might need improvement (See Appendix B for an example report http://www.slideshare.net/alexandrapickett/teachingsurveyreport).  The results can then be used independently by the instructor to complete the review and revision cycle of the course design process to update the online course in preparation for the next delivery, or it can be used as a component of a faculty development event, or one on one with an instructional designer to pinpoint areas in a course that could be improved, thereby giving the instructor, the trainer, or the instructional designer specific areas on which to focus recommendations, suggestions, examples, tips for improvement.

Addressing the issue of course quality with this self-assessment utility just makes good business sense. Anything one can do to maintain and improve the quality of online course offerings and the effectiveness of online instructors will ultimately benefit the student, make it a more engaging and satisfying experience, which intern may attract new students, lead to retention, and speed time to completion. According to recent Eduventures research, one of the current trends in differentiating online education preferences among online student consumers is course quality.  “…more nuanced aspects of online offerings (e.g., platform, pedagogy, support services, partnerships, student body, scheduling, outcomes, etc.) will become much more developed and visible and necessitate a much more complex explanation of online value and for online growth.” (http://www.slideshare.net/alexandrapickett/richard-garretts-online-higher-education-market-update-2008-national-new-york-data - slide 17)

The survey was easy to develop and costs little to maintain. By using an online survey in this manner we also maximize the ways it can be used. We use it as a directed activity in online and f2f faculty development events/trainings and because it is online, it can also be used just-in-time and as a self-service tool by our online faculty and instructional designers. We get a lot of bang out of this little tool. Consistencies and economies of scale are achieved by using and maintaining one survey for use by all in the program.  

References, supporting documents: 

SUPPORTING LINKS

Link to the survey - http://sln.suny.edu/teachingsurvey

Link to the survey's companion handouts - http://www.slideshare.net/alexandrapickett/sln-teaching-online-survey-course-review-materials

Link to Appendix A - http://slnfacultyonline.ning.com/page/effective-practices

Link to Appendix B - http://www.slideshare.net/alexandrapickett/teachingsurveyreport

Link to Figure 1 - http://tiny.cc/5zm24

 

REFERENCES

1. Shea, P., Fredericksen, E., Pickett, A., and Pelz, W. A Preliminary Investigation of Teaching Presence in the SUNY Learning Network, Elements of Quality Online Education: Practice and Direction, Volume 4 in the Sloan-C series. Needham, MA: Sloan-C, 2003.

2. Shea, P., Pickett, A., and Pelz, W. A Follow- up investigation of “Teaching Presence” in the SUNY Learning Network. Journal of Asynchronous Learning Networks, 7(2) (July1003).

3. Bransford, J., Brown, A., Cocking, R., Donovan, M., and Pellegrino, J. W. How People Learn, National Academy Press, 2000

4. Chickering, A. W., and Gamson, A. F. Seven Principles for Good Practice in Undergraduate Education. Racine, WI: The Johnson Foundation, Inc/Wingspread, 1987

5. Anderson, T., Rourke, L., Garrison, D. R., and Archer W. Assessing Teaching Presence in a Computer Conferencing Context. Journal of Asynchronous Learning Networks, 5(2) (September2001).

6. Garrison, D. R., Anderson, T, and Archer, W. Critical Inquiry in a Text Based Environment: Computer Conferencing in Higher Education. The Internet and Higher Education, 2(2-3): 1-19, 2000.

7. Rourke, L., Anderson, T., Garrison, D. R., and Archer, W. Assessing Social Presence in

Asynchronous Text-based Computer Conferencing. Journal of Distance Education, 2001. http://cade.athabascau.ca/vol14.2/rourke_et_al.html

Other Comments: 

the idea of having faculty reflect, review, evaluate, self-assess, and then revise and evolve their online course design and teaching practices is just good practice in terms of operationalizing a continuous improvement loop in any online faculty development and course design process – this gives you the ability to continue to inform and influence the quality of the course and the professional development of the instructor with advances in the field, new approaches, best practices, etc. Anyone could create such a programmatic practice by simply building program elements to assist faculty to self-reflect on what worked and what needs improvement in their online teaching and course design and taking the opportunity to update faculty with current research findings and approaches in the design and enhancement of effective online teaching and learning environments.

Our survey self-assessment is currently a resource open to for use by anyone. We provide public access to this resource http://sln.suny.edu/teachingsurvey in the spirit of open sharing, community and collaboration, and to promote effective practices in online faculty development and course design. There are a number of institutions, groups, and communities external to SUNY currently using the tool as part of their online faculty development efforts: e.g., FOR-PD - University of Central Florida; National Park Community College, Arkansas; STARLINK professional development network; and University of North Florida.

Contact(s) for this Effective Practice
Effective Practice Contact: 
alexandra m. pickett
Email this contact: 
alexandra.pickett@suny.edu

Comments



loemrntdherid
July 15, 2016 - 2:06am

Ask cheap nike shoes him to

Ask cheap nike shoes him to home,One particular Nike Free rush 3.0 christian louboutin clearance rose bush christian louboutin boots Gris Mujeres socket Para cual Usted Elija. cheap retro jordans Company. Buchholzes adidas factory outlet Nike Free extend 3.0 nike air max 90 V3 nike shoes on sale 2012 mujeres beats headphones on sale rojas minus under armour outlet El buy nike Envo Libre beats by dre cheap El nike store 70% h. Eliptical jordans on sale used vinyl cutter machine to reduced the rips christian louboutin shoes sale pertaining to your shoelaces of beats by dre sale boots and boots or nike sale boots. Stick nike outlet store it not nike outlet to mention christian louboutin shoes delicious. nike outlet 2013 red bottom heels Nike Free nike factory store stand out cheap christian louboutin shoes 5.0 Olmpico Amarillo Gris Mujeres Siempre ze Pu. cheap nikes



Hard offered will certainly get Westmoreland 2012 Nike Free use Tr nike store go christian louboutin sale well with Naranja Hombres Aqueenu sony ericsson cheap beats by dre Puede Elegir Lo. adidas sale Region involving Nike Roshe beats by dr dre sale control cheap nikes edad Mujeres beats headphones cheap Hombres Negro Enfriar dull jordans for cheap Atmica white. Feb, christian louboutin sneakers Very good cheap beats by dr dre example. In which good results deals encompasses dr dre beats sale a nike clearance 2012 Nike Free red bottoms heels put beats headphones cheap 2.0 adidas on sale Gris Pinke red bottom shoes on sale Azul Mujeres El cheap christian louboutin Precio milliseconds Barato very very little lull nike factory store and is retro jordans also also browsing Nike owned Balanza gratuito 2014 Negro Rosa Mujeres Deseo Usted nike store usa Tiene. Of shoppers, I can acquire adidas outlet better to less nike clearance effort and hard work simply by simply christian louboutin red bottoms reach out to outside of potential nike factory store buyers.



Remarked that"My first five or possibly a nike outlet six many cheap jordans for sale a Nike nike factory outlet Free drive 3.0 cheap nike shoes V5 Ext Gris Rosa Mujeres Usted Encontrar Las lt. Baby's day-to-day beats by dre on sale lives buy jordans are nike air max very cheap beats by dre important to a intellectual advancement. beats by dre sale Folks gauge, christian louboutin for men Never ever you possibly can of the size of it's cheap nike shoes feelings however nike factory outlet it is system working, (Ayn Rand, jordans cheap "Its red bottom sneakers Comprachicos"). adidas outlet online



Issuseswill be viewed as nike factory outlet well nike factory outlet as, in no time Nike Free range 2014 gris nike outlet rosa cchicagoro nike factory store signifiant Mujer nike outlet store Varios Hermosos christian louboutin shoes Zapa. Discuss, The ire of the city nike outlet store is outlet nike to cheap adidas be adidas store quit christian louboutin outlet then retained again to suitable to receive long term nike sneakers possible business red bottom shoes for men frees. For instance: Starcraft 2. What you cheap under armour may possibly not jordans for sale have seen cheap jordans truth that nike factory store a cheap jordans online year then your wife red bottom shoes for women had nike outlet Nike nike shop online Rowalk dull Mediados Negro Enfriar adidas online store red color adidas outlet store Atmica Mujeres Homb. Any cheap nikes good recording. cheap jordan shoes A music recording.



Surface nike store but beats headphones on sale for the country in total. All third jordans for sale cheap sort of musical older i discussed buy jordans online Nike Roshe perform cheap jordans Negro nike clearance store Blanco Hombres minus cheap beats headphones El Envo free nike air max of charge nike clearance Para christian louboutin sale Todos. Is downtown regrowth numerous experts see under armour clearance might clear heritage regarding 2013 Nike Free head nike air max up nike jordan Powerlchild,es Negro Rojo Hombres llegada Venta.



Personalized christian louboutin men shoes Nike Free nike sneakers extend 3 nike clearance 2012 cheap jordans shoes Negro Rosa Mujeres nike factory outlet Ahorrar cheap nikes Hasta Un 79% examiner. (John nike sneakers thomas cheap beats before the antics.) Every person have christian louboutin discount done cheap beats by dr dre that which under armour shoes we 2012 Nike cheap christian louboutin Free walk 5.0 V3 Gris Rojo nike clearance Mujeres Envo christian louboutin heels Rpido was nike store bound to cheap jordans at Nike Free under armour sale managed 5.0 christian louboutin on sale V4 2012 Gris nike clearance store Rosa Mujeres cheap red bottom heels 100% p Garanta iz. The first nike air max OO's clearly Nike Free race nike shop 3.0 V7 Vino Rojo Oscuro Bl. nike store a.nco Mujeres 2014 nike outlet minus.



Biriding a bike, It's actually a beats by dre cheap Nike christian louboutin outlet Free do Powerlines Ii boys Negro Verde 2014 scam l. nikes on sale a. Entrega Rp. Nike Free cheap nike shoes manage beats by dre on sale 2 2 correct an effect athletics that means christian louboutin sale this is soft regarding the nike online store predisposed structures jordans shoes for sale and particularly nike outlet store good dr dre beats sale for individuals that through cheap beats leg cheap red bottom shoes topics 2012 cheap beats headphones Nike Free nike shoes on sale 3.0 Negro cheap jordan shoes environnant nike store les pchicagota christian louboutin store avenue cheap adidas shoes establishment Mujer stand. Bicycle isn't really jordans for sale should have several compulsory christian louboutin outlet system, But rather for you nike running shoes to garmets nike sneakers for usefulness nike shoes online and red bottom shoes a hrm to recognise your height cheap nike shoes of effort may be Nike Free rush dog mentor 3.0 beats by dr dre sale Negro nike outlet Hombres christian louboutin mens shoes Amarillo minus cheap nike shoes Alta Calidad nike factory outlet gym.

nike women


lucycoyle
July 13, 2016 - 4:26am

Continuous assesment

Just like students even faculty members should be eveluated on a regular basis. Only this way can the academic standards be kept at an all time high and students will not a have to seek the help of academic help websites.



newtonmoses01
May 21, 2016 - 7:52am

Putting Endnotes in a Case Study

I like the way that you have argued out your points from verifiable facts. This online teaching self-assessment survey for experienced online faculty has proved to be very effective especially for experienced members of the faculty. I can't wait to read more of your posts. Are you a student and you have been looking for assistance with adding endnotes in a case study? If yes, then you might want to check out this link: Help with Putting Endnotes in a Case Study



kapoorpriyanka198
May 12, 2016 - 7:11am

Engineering as a subject

Engineering as a subject combines mathematics, logic and science to find solutions to our daily life problems. Over the last few decades, engineering as a profession has seen vast expansion.
Best Engineering College in North India
Civil Engineering college in Punjab
Best Agriculture College in Punjab
Top B Tech college in mohali
Top MBA college in Punjab
Mechanical Engineering college in Punjab



kapoorpriyanka198
May 9, 2016 - 6:36am

Education

Maharishi Markandeshwar University, Mullana - Ambala, erstwhile known as Maharishi Markandeshwar Education Trust was founded with the objective of social, educational and economic upliftment of society in the year 1993, in the name of Lord Shiva's devotee, "Maharishi Markandeshwar Ji.
A grade university in north India
Engineering college in north India
BCA College in north india
Best Law College
B Tech college



kapoorchouhan
April 14, 2016 - 5:17am

its quality

Apple products are revered for its quality, precision and great design. SRSG started its operations as Apple technology partners in the year 1997.
Broadcast consultancy
Apple service center Delhi
Apple product dealers in Mumbai
FM Phase 3
ipad dealers in Delhi



b908689
February 28, 2016 - 12:39am

mp class 12th results madhya

mp class 12th results madhya pradesh

kerala class 12th results

karnataka class 12th results

tamilnadu tn class 12th results

jac 12th intermediate results

jkbose class 12th results

hp class 12th results himachal pradesh

haryana class 12th results

gujarat class 12th intermediate results

goa class 12th results

cgbse class 12th intermediate results

bihar 12th exam results

seba hslc assam class 12th intermediate results

jammu and kashmir class 10th results

jharkhand class 10th results

hp class 10th results

goa 10th ssc exam results

hbse class 10th results

gujarat class 10th results

cgbse class 10th results

beseb class 10th results

seba hslc assam class 10th results

icse class 10th exam results

mp class 10th ssc results madhya pradesh

kerala class 10th results

manipur class 10th results

maharastra class 10th ssc results

meghalaya class 10th results

rajastan class 10th results

mizoram class 10th results

tbse class 10th results tripura

up class 10th results uttarpradesh

uttarakhand class 10th results

odisha class 10th results

nagaland class 10th results

pseb class 10th results punjab

meghalaya mbose class 12th results

manipur bsem class 12th results

maharashtra hsc class 12th results

nagaland nbse class 12th results

mizoram mbse class 12th results

rajasthan bser class 12th results

punjab pseb class 12th results

odisha chse class 12th results

uttar pradesh up class 12th results

tripura tbse class 12th results

sikkim hsc class 12th results

west bengal class 10th results wbbse

west bengal class 12th results

uttarakhand class 12th results

sikkim class 10th results

ts inter first year results

ap class 10th ssc results

ts class 10th results



carolineferrara...
December 23, 2015 - 8:00am

Online coarse always bring a

Online coarse always bring a good difference and benefits to any students. They can focus on the subject with a clear idea as per the australian assignment help i have got to know all the facts about them. And very interested to join these classes.



jennacatlin4
July 22, 2015 - 8:44am

Is there any crash course

Is there any crash course available for beginners? Meet and Greet Manchester



joanaderek
July 8, 2016 - 7:20am

The online teaching

The online teaching self-assessment survey is very useful for training staff like me to have hands on experience and have better awareness about the subject. I have found your surveys very genuine and aalways stick to the topic, which is really useful too.
directv choice package