Pedagogy for Evidence-Based Flipped Classroom - Part 3: Evaluation

Pedagogy for Evidence-Based Flipped Classroom - Part 3: Evaluation

S. CHEAH, D. SALE (2017).  Pedagogy for Evidence-Based Flipped Classroom - Part 3: Evaluation. 15.

This paper shares the results of a study undertaken by the Diploma in Chemical Engineering (DCHE) to evaluate the effectiveness of flipped classroom implemented in a Year 3 core module entitled Plant Safety and Loss Prevention for the past 2 years. The study concerned the redesign of the module using an evidence-based teaching approach supported by extensive use of info-communication technology (ICT) tools.

The paper consists broadly of 3 sections. The first section firstly provide a brief but concise literature review of the flipped (also known as inverted) classroom approach. Being a relatively new approach to teaching and learning, flipped classroom had garnered strong followers in many disciplines from medical to mathematics to engineering to business, and yet at the same time raised doubts over its viability and long-term effectiveness. Given the conflicting findings to-date, this paper strives to provide a balanced view of the relative merits of the approach, as well as challenges faced from both the perspective of faculty and students. This concludes with a summary of calls by various authors for a more comprehensive study of flipped classroom.

Section two of the paper then shares the approach taken by the authors who had collaborated to design a comprehensive blended learning research to qualitatively assess the effectiveness of flipped classroom as applied in the context of the above said module. The first author is the subject-matter expert in the field of chemical process safety while the second author is the educational advisor and specialises in the way humans learn. This paper builds of the curriculum re-design effort presented by the authors in previous CDIO conferences. The pedagogy for evidence-based teaching using the flipped classroom is presented in a separate paper for this conference. In this paper, we share a heuristic developed by the second author of an evidence-based framework for evaluating teaching and learning experiences, with a view to unpacking the components of the experience and identifying which features have significantly impacted student learning (e.g. positively, negatively or other), and on what basis. These include learning events (e.g. a lesson, workshop session) that has been conducted, or in predicting the likely outcomes for a planned future event. The research lasted 6 weeks, implemented from mid-April till end-May 2016. It is worth noting that flipped classroom was implemented for the entire duration of the module, which is 15 weeks. Students are selected to take part in the research as co-participants, providing feedback on their learning experience. The first author who conducted the lessons, regularly reflected on his teaching practices, and often made improvements to his teaching materials within days upon the conclusion of each lesson.

The last section of the paper shares the findings from this study, and limitations of current work. It concludes with our frame on the state of flipped classroom and our plans to move forward in this exciting new educational approach.

Proceedings of the 13th International CDIO Conference in Calgary, Canada, June 18-22 2017

Authors (New): 
Dennis SALE
Singapore Polytechnic, Singapore
Flipped Classroom
Evidence-based Approach
Chemical Engineering
CDIO Standard 8
CDIO Standard 12
Abeysekera, L., & Dawson, P. (2015). Motivation and Cognitive Load in the Flipped Classroom: Definition, Rationale and a Call for Research, Higher Education Research & Development, Vol.34, No.1, pp.1-14 : 
Ash, K. (2012). Educators View ‘Flipped’ Model with a More Critical Eye, Education Week, pp.S6-S7: 
Baker, J.W. (2000). The ‘Classroom Flip’: Using Web Course Management Tools to Become the Guide by the Side, 11th International Conference on College Training and Learning, Jacksonville, FL : 
Bergmann, J., & Sams, A. (2012). Flipped Your Classroom: Reach Every Student in Every Class Every Day, International Society for Technology in Education : 
Berrett, D. (2012). How 'Flipping' the Classroom Can Improve the Traditional Lecture, The Chronicle of Higher Education : 
Betihavas, V., Bridgman, H., Kornhaber, R. & Cross, M. (2016). The Evidence for “Flipping Out”: A Systematic Review of the Flipped Classroom in Nursing Education, Nurse Education Today, Vol.38, pp.15-21 : 
Bishop, J.L., & Verleger, M.A. (2013). The Flipped Classroom: A Survey of the Research, 120th ASEE Annual Conference and Exposition, June 23-26; Atlanta, G.A. : 
Bluic, A.-M., Goodyear, P., & Ellis, R. A. (2007). Research Focus and Methodological Choices in Studies into Students’ Experiences of Blended Learning in Higher Education, Internet and Higher Education, Vol.10, pp.231–244 : 
Butt, A. (2014). Student Views on the Use of a Flipped Classroom Approach: Evidence from Australia, Business Education & Accreditation, Vol.6, No.1, pp.33-43 : 
Cheah, S.M., Sale, D., & Lee, H.B. (2017). Pedagogy for Evidence-based Flipped Classroom – Part 2: Case Study, paper prepared for the 13th International CDIO Conference, June 18-22; University of Calgary, Alberta, Canada : 
Cheah, S.M., Lee, H.B., & Sale, D. (2016). Flipping a Chemical Engineering Module using an Evidence-based Teaching Approach, Proceedings of the 12th International CDIO Conference, June 12-16; Turku University of Applied Sciences, Turku, Finland: 
Crews, T., & Butterfield, J. (2014). Data for Flipped Classroom Design: Using Student Feedback to Identify the Best Components from Online and Face-to-Face Classes, Higher Education Studies, Vol.4, No.3, pp.38-47 : 
Davies, R.S., Dean, D.L., & Ball, N. (2013). Flipping the Classroom and Instructional Technology Integration in a College-level Information Systems Spreadsheet Course, Education Tech Research Dev, Vol.61, pp.563-580 : 
Deslauriers, L., & Wierman, C. (2011). Learning and Retention of Quantum Concepts with Different Teaching Methods, Physical Review Special Topics, Physics Education Research, Vol.7, pp.1-6 : 
Deubel, P. (2013). Is It Really Hip to Flip? T.H.E. Journal, accessed July 21, 2016. 
Dove, A. (2013). Students’ Perceptions of Learning in a Flipped Statistics Class. In R. McBride & M. Searson (Eds.), Proceedings of Society for Information Technology & Teacher Education International Conference 2013 (pp. 393-398). Chesapeake, VA: Association for the Advancement of Computing in Education (AACE). : 
Fautch, J.M. (2014). The Flipped Classroom for Teaching Organic Chemistry in Small Classes: Is it Effective? Chemistry Education Research & Practice, Vol.16, pp179-186 : 
Forsey, M., Low, M., & Glance, D. (2013). Flipping the Sociology Class: Towards a Practice of Online Pedagogy, Journal of Sociology, Vol.49, No.4, pp.471-485 : 
Ginns, P., & Ellis, R. (2007). Quality in Blended Learning: Exploring the Relationships between On-line and Face-to-face Teaching and Learning, Internet and Higher Education, Vol.10, pp.53-64 : 
Gojak, L. (2012). To Flip or Not to Flip: That is Not the Question, Summing Up, October Issue, National Council of Teachers of Mathematics : 
Goodwin, B., & Miller, K. (2013). Research Says/ Evidence on Flipped Classrooms Is Still Coming In, Technology-Rich Learning, Vol. 70, No. 6, pp.78-80 : 
Hamdan, N., McNight, P., McNight, K., & Arfstrom, K.M. (2013). A Review of Flipped Learning, Flipped Learning Network: 
Hattie, J. (2009). Visible Learning. Routledge, New York: 
Hawk, S.J. (2014). The Flipped Classroom: Now or Never? Education News, AANA Journal, Vol.82, No.4, pp.264-269 : 
Herreid, C.F. and Schiller, N.A. (2013). Case Studies and the Flipped Classroom, Journal of College Science Teaching, National Science Teachers Association, pp.62-66. : 
Jensen, J.L., Kummer, T.A., & Godoy, P.D.d.M. (2015). Improvements from a Flipped Classroom May Simply Be the Fruits of Active Learning, CBE Life Sciences Education, Vol.14, pp.1-12 : 
King, C., & Piotrowski, C. (2015). E-learning and Flipped Instruction Integration in Business Education: A Proposed Pedagogical Model, Journal of Instructional Pedagogies, Vol.16, pp.1-9 : 
Lage, M.J., Platt, G.J., & Treglia, M. (2000). Inverting the Classroom: A Gateway to Creating an Inclusive Learning Environment, The Journal of Economic Education, Vol.31, No.1, pp. 30-43: 
Lape, N.K., Levy, R., Yong, D.K., Haushalter, K.A., Eddy, R., & Hankel, N. (2014). Probing the Inverted Classroom: A Controlled Study of Teaching and Learning Outcomes in Undergraduate Engineering and Mathematics, 121st ASEE Annual Conference and Exposition, June 15-18; Indianapolis, IN : 
Lincoln, Y.S. (1990). The Making of a Constructivist: A Remembrance of Transformations Past, in E. G. Guba (Ed.), The Paradigm Dialog, Sage: London : 
Margulieux, L., Majerich, D., & McCraken, M. (2013). Guide to Flipping Your Classroom, Center for 21st Century Universities, Georgia Tech. : 
Mason, G.S., Shuman, T.R., & Cook, K.E. (2013). Comparing the Effectiveness of an Inverted Classroom to a Traditional Classroom in an Upper-Division Engineering Course, IEEE Transactions on Education, Vol.56, No.4, pp.430-434 : 
McLaughlin, J.E., Griffin, L.M., Esserman, D.A., Davidson, C.A., Glatt, D.M., Roth, M.T., Gharkholonarehe, N., & Mumper, R.J. (2013). Pharmacy Student Engagement, Performance, and Perception in a Flipped Satellite Classroom, American Journal of Pharmaceutical Education, Vol.77, No.9, pp.1-8 : 
McWilliam, E.L. (2005). Unlearning Pedagogy, Journal of Learning Design, 1(1), pp.1-11: 
Moffett, J. (2014). Twelve Tips for “Flipping” the Classroom, Medical Teacher, Apr 37(4):33, pp.1-6 : 
Moraros, J., Islam, A., Yu, S., Banow, R., & Schindelka, B. (2015). Flipping for Success - Evaluating the Effectivness of a Novel Teaching Approach, BMC Medical Education, 15:27 : 
Murray, D., Koziniec, T., & McGill, T. (2015). Student Perceptions of Flipped Learning, Proceedings of the 17th Australasian Computer Education Conference (ACE 2015), January 27-30; Sydney, Australia. : 
Norrman, C., Bienkowska, D., Moberg, M., & Frankelius, P. (2014). Innovative Methods for Entrepreneurship and Leadership Teaching in CDIO-based Engineering Education, Proceedings of the 10th International CDIO Conference, June 16-19; Universitat Politècnica de Catalunya, Barcelona, Spain: 
O'Flaherty, J., & Phillips, C. (2015). The Use of Flipped Classrooms in Higher Education: A Scoping Review, Internet and Higher Education, Vol.25, pp.85-95 : 
Pienta, N.J. (2016). A “Flipped Classroom” Reality Check, J. of Chemical Education, Vol.93, pp.1-2 : 
Redekopp, M.W., & Ragusa, G. (2013). Evaluating Flipped Classroom Strategies and Tools for Computer Engineering, 120th ASEE Annual Conference and Exposition, June 23-26; Atlanta, GA : 
Sale, D., & Cheah, S.M. (2017). Pedagogy for Evidence-based Flipped Classroom – Part 1: Framework, paper prepared for the 13th International CDIO Conference, June 18-22; University of Calgary, Alberta, Canada : 
Sale, D. (2015). Creative Teaching: An Evidence-Based Approach. New York: Springer: 
Seery, M.K. (2015). Flipped Learning in Higher Education Chemistry: Emerging Trends and Potential Directions, Chem. Educ. Res. Pract., Vol.16, pp.758-768 : 
Sinouvassane, D., & Nalini, A. (2016). Perception of Flipped Classroom Model among Year One and Year Three Health Science Students, International Journal of Information and Education Technology, Vol. 6, No. 3, pp.215-218 : 
Stanley, R., & Lynch-Caris, T. (2014). An Innovative Method to Apply the Flipped Learning Approach in Engineering Courses Via Web Based Tools, Proceedings of the 2014 ASEE Gulf-Southwest Conference, New Orleans, LA: 
Straw, S., Quinlan, O., Harland, J., & Walker, M. (2015). Flipped Learning Research Report, National Foundation for Educational Research (NFER) and NESTA : 
Strayer, J.F. (2012). How Learning in an Inverted Classroom Influences Cooperation, Innovation and Task Orientation, Learning Environ Res, Vol.15, pp.171-193: 
Van Sickle, J. (2016). Discrepancies between Student Perception and Achievement of Learning Outcomes in a Flipped Classroom, Journal of the Scholarship of Teaching and Learning, Vol.16, No.2, pp. 29-38 : 
Van Vliet, E.A., Winnips, J. C., & Brouwer, N. (2015). Flipped-Class Pedagogy Enhances Student Meta-cognition and Collaborative-Learning Strategies in Higher Education But Effect Does Not Persist, Life Sciences Education, Vol.14, pp.1-10 : 
Velegol, S.B., Zappe, S.E., & Mahoney, E. (2015). The Evolution of a Flipped Classroom: EvidenceBased Recommendations, Advances in Engineering Education, Vol.4, No.3, pp.1-37 : 
Warter-Perez, N., & Dong, J. (2012). Flipping the Classroom: How to Embed Inquiry and Design Projects into a Digital Engineering Lecture, Proceedings of the 2012 ASEE PSW Section Conference: 
Whillier, S., & Lystad, R.P. (2015). No Difference in Grades or Level of Satisfaction in a Flipped Classroom to Neuroanatomy, J Chiropr Educ, Vol.29, No.2, pp.127-33: 
Wilson, S. (2014). The flipped class: A Method to Address the Challenges of an Undergraduate 1Statistics Course, Teaching of Psychology, 40(3), 193–199 : 
Yarbro, J., Arfstrom, K.M., McKnight, K., & McKnight, P. (2014). Extension of a Review of Flipped Learning, The Flipped Learning Network : 
Go to top