{"id":220,"date":"2014-07-30T13:56:21","date_gmt":"2014-07-30T13:56:21","guid":{"rendered":"http:\/\/hets.org\/ejournal\/?p=220"},"modified":"2014-07-30T13:56:21","modified_gmt":"2014-07-30T13:56:21","slug":"integrated-learning-and-the-value-of-value-rubrics","status":"publish","type":"post","link":"https:\/\/hets.org\/ejournal\/integrated-learning-and-the-value-of-value-rubrics\/","title":{"rendered":"Integrated Learning and the Value of VALUE Rubrics"},"content":{"rendered":"

Background<\/span><\/strong><\/p>\n

\u00a0<\/span><\/p>\n

We are engaged in nothing less than an effort to change the focus of the national conversation from artificial, shorthand indicators of learning to something that reflects the shared work and understanding of faculty members and academic professionals across campuses\u201d<\/span><\/p>\n

\u00a0–Terrel L. Rhodes<\/span><\/p>\n

The Association of American Colleges & Universities focuses its approach on student learning outcomes through its LEAP (Liberal Education America\u2019s Promise) VALUE (Valid Assessment of Undergraduate Education) Rubrics, a set of general education rubrics developed by faculty groups across the country looking internally at common general education outcomes. The process for developing the rubrics emerged from \u201cPrinciples of Excellence\u201d developed by a leadership council of educators, which include:\u00a0 \u201cgiving students a compass (focus each student’s plan of study on achieving the essential learning outcomes–and assess progress)<\/em>, teach the arts of inquiry and innovation, connect knowledge with choice and action, assess students\u2019 ability to apply learning to complex problems\u201d (AAC&U).\u00a0 The internal yet cross-national look at refined student outcomes through the VALUE rubrics has the potential to measure student outcomes across campuses, across classrooms and longitudinally through multiple iterations.<\/span><\/p>\n

As one of 12 community colleges named by the AAC & U and MetLife as Giving a Roadmap: Enrollment to Engagement in Educational Achievement and Success Campuses, Queensborough Community College was invited to apply to the Collaborative on Authentic Assessment of Learning (CAAL):pilot, and \u00a0was accepted to participate.<\/span>\u201d\u00a0<\/span>\u00a0<\/span>CAAL is currently being developed to provide a virtual community where institutions can upload, share, and discuss their campus assessment results using the VALUE rubrics. This collaboration among\u00a0<\/span>e-portfolio vendors\u00a0<\/span>and campuses is intended to expand communication across campuses regarding common instruments, compelling findings, potential benchmarks for student success, and best practices of assessment using rubrics and e-portfolios.<\/span>\u201d<\/span>\u00a0Queensborough was tasked to score the Integrative Learning Value Rubric on 100 student work samples. The scores and samples will be placed in a repository.<\/span>Queensborough\u2019s \u201cRoadmap\u201d activities, made possible by the Freshman Academy structure launched in 2009, will therefore be deepened and better supported, as the current student learning outcome work is currently being implemented as a teaching and learning tool as much as an assessment tool in small interdisciplinary faculty cohorts on campus approaching high impact strategies<\/span>\u00a0<\/span>. The detailed attention to naming principles of excellence and general education outcome rubrics as in the LEAP VALUE project offer the opportunity for a culture of evidence that allows for a reflection process that focuses on student learning,\u00a0<\/span>as well as partnerships with business groups and state officials to ensure not only greater access but greater success in United States higher education and the workplace.<\/span>Through the use of rubrics, students, notably historically underserved and first generation college students, are given a clear outline of expectations, assisting them in the achievement of the learning outcomes which will enable them to complete their educational goals.<\/span><\/p>\n

Organizing a First Year Experience:<\/strong><\/p>\n

Queensborough Community College\u2019s goal is to provide an academic environment that strengthens students\u2019 commitment and makes it possible for them to graduate or complete their goals in a timely manner. In the fall of 2009, after 8 years of preparation Queensborough launched the Freshman Academies. All first-time, full-time students are enrolled in one of six Freshman Academies based upon his\/her chosen field of study. The six Freshman Academies are Science, Technology, Engineering and Math; Liberal Arts; Visual and Performing Arts; Education; Health Related Sciences; and Business. \u00a0<\/span>What is different about Queensborough\u2019s Freshman Academies is that it is a scaled-up and institutionalized effort for activities which rarely move beyond the pilot stage and rarely reach the least prepared student, and concentrate all services into six academies for all first-time, full-time freshmen.\u00a0\u00a0\u00a0 The Freshman Academies are mandatory for all 3241 first-time, full-time freshman who enrolled at this open access community college of the City University of New York during the fall 2009.<\/p>\n

Academic Enhancement: High Impact Strategies & Integrated Learning:<\/strong><\/p>\n

The academic enhancement initiative centers on the directed focus of high impact classroom strategies in the first 30 credits. George Kuh, who first identified high impact practices through a study of the National Survey of Student Engagement (2008) writes<\/span>.\u00a0\u201cThe results of participating in these high-impact practices are especially striking for students who are further behind in terms of their entering academic test scores.\u00a0 The benefits are similarly positive for students from communities that historically have been underserved in higher education.\u201d<\/p>\n

 <\/p>\n

At Queensborough, the high impact strategies for freshman include cornerstone courses, e-portfolio, learning communities, service learning, and writing intensive courses.<\/p>\n

    \n
  1. 1.\u00a0\u00a0\u00a0\u00a0\u00a0 Cornerstone Courses are introductory courses that teach general education skills of communication, critical thinking, organization and development of values.<\/li>\n
  2. 2.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0e-Portfolio is a personalized, electronic archiving system which allows students to express their educational goals and see their own progress as a student as they move through college. It can also incorporate social networking.<\/li>\n
  3. 3.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Learning Communities are two courses taught by two different professors which are linked by a theme.\u00a0 The same students are in each of the classes.\u00a0 These classes assist students in seeing connections between disciplines, and help them get to know their fellow students and professors.<\/li>\n
  4. 4.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Service Learning employ class assignments that take students\u2019 work out into the community.\u00a0 Students learn more about the subject they are studying while making an impact outside the classroom, encouraging civic engagement.<\/li>\n
  5. 5.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span>Writing Intensive Courses are specifically designed to improve students\u2019 writing ability through all the academic disciplines.\u00a0 Two writing intensive courses are\u00a0required to graduate.<\/span><\/li>\n<\/ol>\n

    All five of the high impact strategies had been adopted by faculty members before the launching of the academies.\u00a0 The academies initiative has served to target, promote and scale up the high impact strategies, as well as to examine best practices and general education objectives in relation to those strategies.\u00a0 As students began to hone an academic identity by virtue of membership in one of six academies based on field of major interest, the role of participating faculty expanded beyond individual discipline identifications into the multidisciplinary academies.\u00a0 Greater faculty consciousness of general education and the students’ complete academic paths has been achieved through efforts to implement and assess high impact strategies on a larger scale.<\/span><\/p>\n

    \u00a0<\/span><\/p>\n

    To support and promote the high impact strategies and co-curricular activities, as well as to serve as a communicative bridge to the Freshman Coordinators (Student Affairs personnel described as \u201crelationship guides\u201d who provide enhanced advisement and referral to freshman), a group of faculty leaders have emerged who serve as Faculty Coordinators, Learning Outcomes Facilitators and Basic Education\/Developmental Mathematics.\u00a0 The faculty leaders meet regularly with freshman coordinators and participate in Freshman Orientation and other Academy gatherings with students. They also facilitate interdisciplinary faculty cohort groups which meet throughout the semester to discuss best practices as well as to support the development and implementation of cross cutting general education rubrics.\u00a0 The General Education Objective rubrics, which focus on speech, reading, writing and quantitative illiteracies served not only as assessment tools, but as a method of communication of expectation and goal setting for students in the classroom.<\/span><\/p>\n

    \u00a0<\/span><\/p>\n

    By Fall 2010, the Learning Communities Initiative began to implement the Integrated Learning VALUE rubric as a tool to demonstrate student integration of the two disciplines that comprised each Learning Community.\u00a0<\/span><\/p>\n

    \u00a0<\/span><\/p>\n

    The interdisciplinary conversations that ensued among the faculty have created a greater consciousness of the general education objectives that had been voted on by the faculty as well as led to examinations of the\u00a0 true ‘impact’ of the high impact activities in dialogue with the principal investigator of the Freshman Academies Assessment Protocol and the Office of Academic Affairs.<\/span><\/p>\n

    \u00a0<\/span><\/p>\n

    The feedback loop from faculty to student and among faculty have initiated greater articulation of integrative strategies in the classroom, such as the institution of supplemental education assignments in Freshman Composition, a cornerstone course in cooperation with the Kupferberg Holocaust Archive and the QCC Art Gallery.\u00a0 Academy specific cornerstone courses have been created which feature readings which relate to students’ field of major interest and assist with making connections to student aspiration.\u00a0 Additional academy specific courses address areas in which certain groups of students traditionally encounter roadblocks, for instance a remedial math class has been formed dedicated to visual and performing arts students which employ the arts to teach basic mathematics.\u00a0 The Student Interdisciplinary Wiki Project incorporates groups of three classes which all participate in a virtual learning community through ePortfolio and shared interdisciplinary wiki assignments, which also layers service learning.\u00a0 The Academies therefore are not only ensuring that students receive two high impact practices, but are attempting to ensure that the quality of these experiences are relevant and memorable. The Student Wiki Interdisciplinary Group began using the Integrated Learning Rubric in Spring 2011, attempting to demonstrate the active reflection on interdisciplinary connections that was inherent in that practice. In Summer 2011, the initiative \u201cMoving Ahead with ePortfolio\u201d incorporated a longitudinal exploration of the Integrated Learning VALUE rubric in classes using ePortfolio integrative learning assignments.<\/span><\/p>\n

    \u00a0<\/span><\/p>\n

    \u00a0As a result of the constant evolution of the high impact practices in their emphasis on interdisciplinarity, experiences beyond the five named high impact strategies occur through the vehicle of the Freshman Academies, such as diversity\/global learning, common intellectual experiences and collaborative project based learning, which have also been named as high impact practices by George Kuh (2008).<\/span><\/p>\n

    \u00a0<\/span><\/p>\n

    The VALUE Rubric and Integrated Learning<\/span><\/strong><\/p>\n

    The VALUE Rubrics reflect the emphasis the academy places on the ability to analyze and integrate knowledge in a variety of ways–\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Terrel L. Rhodes<\/span><\/p>\n

    \u00a0<\/span><\/p>\n\n\n\n
    <\/td>\nAlongside the Principles of Excellence, the LEAP campaign identified a series of Essential Learning Outcomes which include: knowledge of human cultures and the physical and natural world, intellectual and practical skills, personal and social responsibility, and integrated and applied learning. In the case of integrated and applied learning, demonstration is to take place through the application of knowledge, skills and responsibilities to new settings and problems. Teams of faculty and other academic professionals developed fifteen institutional level VALUE rubrics corresponding to elements of the Essential Learning Outcomes using existing campus rubrics, other organizational statements on outcomes, disciplinary expertise and an iterative process which included faculty feedback (AAC & U).<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

    The definition of integrated learning on the VALUE rubric is: \u201cAn understanding and a disposition that a student builds across the curriculum and co-curriculum, from making simple connections among ideas and experiences to synthesizing and transferring learning to new, complex situations within and beyond the campus.\u201d Integrated learning can take place when assignments develop students\u2019 ability to synthesize knowledge and make connections, increasing the potential for personal success, social responsibility and civic engagement. Structures, assignments and environments where the exchange of experience and understanding is encouraged cultivates the opportunity for integrative learning, and is embodied in Queensborough\u2019s practices of Service Learning, Learning Communities and the Student Wiki Interdisciplinary Group.<\/span><\/p>\n

    \u00a0<\/span><\/p>\n

    The rubric holds five dimensions:\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span><\/p>\n

      \n
    1. 1.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Connections to Experience, in which student connects relevant experience and academic knowledge<\/span><\/li>\n
    2. 2.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Connections to Discipline, in which student sees (makes) connections across disciplines and perspectives<\/span><\/li>\n
    3. 3.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Transfer in which student adapts and applies skills, abilities, theories, or methodologies<\/span><\/li>\n<\/ol>\n

      \u00a0\u00a0\u00a0\u00a0\u00a0 gained in one situation to new situation<\/span><\/p>\n

        \n
      1. 4.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Integrated Communication<\/span><\/li>\n
      2. 5.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Reflections and Self-Assessment in which student demonstrates a developing sense of self as a learner, building on prior experiences to respond to new and challenging contexts (may be evident in self-assessment, reflection, or creative work).<\/span><\/li>\n<\/ol>\n

        \u00a0<\/span><\/p>\n

        Performance gradients begin at zero, in which there is no demonstration of a dimension, and then are staged on level 1 as benchmark, the learning skills and abilities among beginning students, levels 2 and 3 as milestones, which suggest key characteristics of progressive learning, and level 4 as capstone, which reflect achievement for the specific criterion for a student who graduates with a BA.<\/span><\/p>\n

        \u00a0<\/span><\/p>\n

        The Collaborative for Authentic Assessment of Learning Pilot Process at Queensborough<\/span><\/strong><\/p>\n

        \u00a0<\/span><\/strong><\/p>\n

        The purpose of the Collaborative for Authentic Assessment of Learning pilot was to gather information on how the process of gathering student work samples and scoring the rubric would interact with the life of the colleges which participated.\u00a0<\/span><\/p>\n

        Queensborough initiated a call for faculty participant \/ student permission forms collected along with their work samples \u2013de-identified through an anonymous numbering system. The permission template provided by the pilot facilitator did not ask demographic information and first generation college status, and it was discovered that there was no database which collected first generation status, so a second round of student work was collected and a more extensive permission form was used.\u00a0 Student work in the Honors Program and students in the Student Interdisciplinary Group from Basic Educational Skills in Reading and Writing, Freshman Composition and content courses in Chemistry, Math, Art History, Business and the Health Sciences comprised the first group of samples collected.\u00a0\u00a0 In addition, a second round of samples were collected from a homogenous group of students all\u00a0 participating in the University Summer Immersion Program which the City University of New York provides for incoming students, all of whom were asked a series of reflective questions.\u00a0<\/span><\/p>\n

        Two separate scoring sessions were held, the first by a group of paid faculty which scored work samples from the honors students and Student Wiki Interdisciplinary Group, the second by tutors from the Basic Educational Skills learning center which scored the reflective essays.\u00a0 The brief training and norming session was met with enthusiasm and vigorous discussion which led to consensus as the understanding and dialogue around the Integrated Learning rubric grew.<\/span><\/p>\n

        Preliminary Observations<\/span><\/strong><\/p>\n

        Work samples had been gathered based on proximity\u2014both the honors program and the Student Wiki Interdisciplinary Group had called for artifacts for demonstration of student learning, so it was an efficient form of collection for the purposes of the study.\u00a0 It was clear from the results that the integrative nature of the Student Wiki Interdisciplinary Group assignments held prompts which led to higher levels of evidence of integrative learning, particularly in the dimensions of Connections to Experience and Reflection and Self-Assessment.\u00a0 Some students in that group had also been introduced to the rubric in the classroom, and the higher scores suggest that inviting students to consider the learning outcomes of the class and providing articulation of what constitutes the ultimate goals in the assignment increases their ability to demonstrate the outcomes sought. The summer immersion pre-college students predictably scored at zero or benchmark levels.\u00a0<\/span><\/p>\n

        Additional qualitative information emerged from a faculty reflection on the process, in which themes of faculty\u2019s deeper understanding of integrative and applied learning emerged from the process of calibrating the rubric and discussing the dimensions with each other. Said one faculty scorer, \u201cProfessor L.\u2019s comment made me understand the difference between \u2018connection to experience\u2019 and \u2018reflection,\u2019\u201d Another faculty member wrote, \u201cI appreciated the time spent in groups collaborating on the scoring process\u2014I now have a better understanding of integrative learning.\u201d\u00a0 A theme emerged in the reflections that faculty would welcome more such opportunities to dialogue on pedagogy. Based on this small sample, it may be suggested that faculty participating in interdisciplinary faculty development may uncover evidence of integrative and applied learning when implementing the rubric in their classrooms, as well as approach those competencies in their classroom informed by their development activities.<\/span><\/p>\n

        \u00a0<\/span><\/p>\n

        \u00a0<\/span><\/p>\n

        Reference List<\/span><\/strong><\/p>\n

        Association of American Colleges & Universities.\u00a0\u00a0VALUE: Valid assessment of learning in<\/em><\/span><\/p>\n

        undergraduate education.<\/em>\u00a0Retrieved on April 12, 2011 from<\/span><\/p>\n

        \u00a0<\/span>http:\/\/www.aacu.org\/value\/index.cfm<\/span><\/a>.<\/span><\/p>\n

        Association of American Colleges & Universities.\u00a0Collaborative for authentic assessment of<\/em><\/span><\/p>\n

        learning.<\/em>\u00a0Retrieved on June 18, 2011 from:\u00a0<\/span>http:\/\/www.aacu.org\/caal\/index.cfm<\/span><\/a><\/p>\n

        Kuh.\u00a0George D. (2008).\u00a0High-Impact Educational Practices: What they are, who has<\/em><\/span><\/p>\n

        access to them, and why they matter<\/em>. Association of American Colleges and Universities. Retrieved on July 18, 2010 from\u00a0www.aacu.org<\/a>.<\/span><\/p>\n

        Rhodes, T.L.\u00a0 (2010).<\/span>\u00a0Assessing outcomes and improving achievement: Tips and tools for using<\/em><\/p>\n

        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 rubrics.<\/em>\u00a0Washington D.C:\u00a0 Association of American Colleges and Universities.<\/p>\n

        \u00a0<\/span><\/p>\n

        \u00a0By: Geralyn Marchisello, MSOL and Michele Cuomo, MFA<\/span><\/p>\n

        Queensborough Community College<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

        Background \u00a0 We are engaged in nothing less than an effort to change the focus of the national conversation from artificial, shorthand indicators of learning to something that reflects the shared work and understanding of faculty members and academic professionals across campuses\u201d \u00a0–Terrel L. Rhodes The Association of American Colleges & Universities focuses its approach […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[23,12,6],"tags":[],"class_list":["post-220","post","type-post","status-publish","format-standard","hentry","category-english","category-fall-issue-october-2011","category-volume-ii"],"_links":{"self":[{"href":"https:\/\/hets.org\/ejournal\/wp-json\/wp\/v2\/posts\/220","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hets.org\/ejournal\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hets.org\/ejournal\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hets.org\/ejournal\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hets.org\/ejournal\/wp-json\/wp\/v2\/comments?post=220"}],"version-history":[{"count":1,"href":"https:\/\/hets.org\/ejournal\/wp-json\/wp\/v2\/posts\/220\/revisions"}],"predecessor-version":[{"id":221,"href":"https:\/\/hets.org\/ejournal\/wp-json\/wp\/v2\/posts\/220\/revisions\/221"}],"wp:attachment":[{"href":"https:\/\/hets.org\/ejournal\/wp-json\/wp\/v2\/media?parent=220"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hets.org\/ejournal\/wp-json\/wp\/v2\/categories?post=220"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hets.org\/ejournal\/wp-json\/wp\/v2\/tags?post=220"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}