Inclusive Assessing: Are All Students Able to Demonstrate What They Know?
Inclusive teaching is at the forefront of many discussions among educators in public schools as well as higher educational institutions. And while these discussions can be challenging in some arenas, I believe that teachers would agree their highest achievement is their students’ learning, mastering the course content and applying their new knowledge to their future goals. Success as a teacher equals the highest percentage of students possible demonstrating their course competency throughout the course in formative assessments and at the end of the term with summative assessments of their mastery.
However, often overlooked in discussions of DE&I are ideas about equitable assessment types. For me, the question is: Am I offering assessments that truly give opportunities for my diverse group of students to demonstrate what they know or have learned? Or am I just relying on my older methods of testing that leave some of my students without a way to show me they really know the material? Am I just asking the wrong questions, or asking them in a way that is confusing or challenging to some groups of students?
I have become aware that there is a huge gap between asking my students to parrot back the course content on a multiple-choice test and truly assessing their mastery of that content. Can they apply that content? Are they able to reason with this new information at the highest level of learning? Have I given them the opportunity to reach the peak of Bloom’s Taxonomy?
We survived teaching through the COVID-19 pandemic, teaching in the early days post-pandemic, and this year we thought we would be returning to some new normal in our classrooms.
But wait, there are new (and not so new) mine fields I’m expected to navigate?!
ChatGPT??
Political climates influencing what and how we teach??
Continuing updates to accessibility??
Commitments to inclusive teaching??
I feel a weariness creeping in as I struggle to stay enthusiastic about this new school year. So, I sought solace from like-minded educators and sources to help renew my excitement and confidence about stepping into the limelight with a whole new, unknown group of students.
What is more precious than freedom? What is more worth celebrating than the end of enslavement and the embrace of freedom? Since 1863, African Americans, as well as many other people, have enthusiastically marked the legal abolition of slavery in the United States.
On January 1, 1863, in the midst of the Civil War, Abraham Lincoln issued the Emancipation Proclamation that touched off wild rejoicing in Black communities in the North. But very few African Americans were actually freed from bondage on that remarkable day. Limited in scope, the Proclamation did not apply to enslaved people living in slave states that had not seceded from the Union such as Maryland and Kentucky, and no slave owner living in the Confederate states freed their slaves because of Lincoln’s order.
Still, many enslaved people seized the opportunity to free themselves in response to the Proclamation, and many thousands more would do so as the War dragged on into 1864 and 1865. Moreover, enslaved people had been freeing themselves long before Lincoln’s Proclamation. Since the first Africans were enslaved in the English colonies in North America in the 1600s, people gained freedom by running away and rising in rebellion. And on April 16, 1862, months before Lincoln’s Proclamation, congress had outlawed slavery in Washington, DC. Slavery did not disappear on a single day and with a single act by the U. S. President. It took time and cost thousands of lives as Black and white U. S. troops fought to win the war, preserve the Union, and end the enslavement of nearly four million people.
How then did Juneteenth come to be a day for commemorating freedom and slavery’s end? Although the Civil War essentially concluded on April 9, 1865, when Gen. Robert E. Lee’s Army of Northern Virginia surrendered to Gen. Ulysses S. Grant and U. S. military forces at Appomattox Court House in Virginia, a few Confederate political and military leaders continued to exercise authority in portions of the South in the vain hope that they might yet achieve victory.
On June 19, 1865, as Union armies gained control of southern Texas, Major General Gordon Granger issued Order #3 in Galveston, freeing those who remained in bondage among the nearly 250,000 people who had been enslaved in the Lone Star State. Nationwide, slavery was finally eradicated with the ratification of the 13th Amendment on December 6, 1865.
In 1866, freed people in Texas began celebrating what they came to call “Juneteenth.” For decades thereafter, Juneteenth was mostly a Texas commemoration. In 1938, Gov. James Allred declared Juneteenth “Emancipation Day.” By then, some Black Texans had joined the Great Migration, and they took Juneteenth festivities with them as they moved to other states, mainly in the North and West.
June 19 became a state holiday in Texas in 1980 thanks largely to the efforts of Houston state legislator Al Edwards. Increasing numbers of African Americans began celebrating Juneteenth as a holiday across the nation in the 1980s and 1990s. By 2006, fifteen states recognized Juneteenth as a state holiday. Opal Lee, a 95-year-old Black woman from Ft. Worth — the “Grandmother of Juneteenth” — saw her persistent efforts to make Juneteenth a national holiday rewarded when President Joe Biden declared on June 17, 2021, that henceforth June 19 would be a national holiday.
Yet long before Juneteenth became a national holiday, African Americans had observed January 1 as Emancipation Day. For decades after the Civil War, the first day of each year was greeted with exuberant gatherings that included parades, music, speeches, sermons, and bountiful portions of food. On the tenth anniversary of the Emancipation Proclamation in 1873, “throngs of colored people” adorned in “gorgeous garments” paraded through the streets of Charleston, South Carolina, accompanied by a band playing “Yankee Doodle.” Among those who participated in the festivities were Congressman Alonzo J. Ransier, the first Black member of the U. S. House of Representatives, as well as Civil War hero Robert Smalls and Major Martin R. Delany.
On January 1, 1900, Tuskegee Institute President Booker T. Washington addressed an Emancipation Day audience in Macon, Georgia, and offered — as he usually did — a message of racial uplift combined with criticism. “The Negro must have education and thrift. They must know how to apply their education. We have enough ministers and professional men for the present. We need to teach the masses how to get out of their shiftless and antiquated ways.”
Although the pageantry of the early commemorations of January 1 faded in the 20th century, Emancipation Day continued to be observed. In 1939, Mary McLeod Bethune, the President of Bethune Cookman College and a member of President Franklin D. Roosevelt’s “unofficial” Black Cabinet, delivered an inspirational message at Allen University in Columbia, South Carolina, as she called on Black people to unite in their quest for a better future and avoid indulging in acrimony and criticism of each other.
The centennial of the Emancipation Proclamation was widely celebrated in 1963 as the civil rights movement gained momentum across the South. Less than nine months before the Rev. Martin Luther King, Jr., delivered his “I have a Dream” speech at the March on Washington, there were a host of Emancipation Day observances across the nation. In Charleston, there was a “gala parade” featuring the contestants in the “Miss Emancipation” contest. The Burke High School and Laing High School marching bands took part. The Rev. Z. L. Grady, an AME minister, addressed a gathering at Jerusalem Baptist Church.
I believe the end of the Spring Term for most higher education instructors is when we are on our last nerve.
We have survived Fall with all the newbies, both colleagues and students. We’ve participated in all the required, seemingly endless, often less than engaging in-services, including one more course on cyber security. We’ve attended all required faculty meetings and served on committees ranging from book selections to searches for new faculty. We’ve updated courses, copied courses, and graded all the work in those courses. As instructors we responded to students’ extra needs ranging from academic mentoring to providing referrals for students struggling with work, home, school, illness, and financial losses. We’ve done this without wavering, well almost without, for 9 months and that summer vacation is within sight.
But wait, in these last few weeks before we reach that holy grail of vacation time, we will wrap up the year with departmental reports, assessments by our accrediting bodies, and institutional reviews. On top of all of that, instructors are bombarded with end of term student pleas to give them extra credit so they can pass. And if they don’t pass, they tell us it’s all our fault their futures will be bleak.
Stress, who’s stressed???? I was, and often still am. I need something to take my frustrations and irritations down a notch, so I can make it down the home stretch without saying something to anyone I would later regret. I turn to purposeful living and the practice of staying in the moment by focusing on the tangibles of the five senses. Let me share a few suggestions you can take as a jumping off point, don’t take that literally, and then make these sensory grounding moments your own.
Touch
Classic studies have revealed how important human touch is for us to thrive. Yet, Covid and a desire to be appropriate with others in all ways may have curtailed our natural impulses to give someone a hug, a squeeze of the hand, or a pat on the back. However, there are many ways to use touch as a safe focus point if interpersonal touch is unavailable. I have found great comfort in kneading dough, digging in the dirt in my garden, or immersing myself in a pool. Skin is the organ of touch, and we all have lots of skin. So, arms, legs, fingers, and toes all count and help us focus our attention on the amazing feeling of something like wriggling our toes in the sands at the edge of a body of water.
Hearing
Beyond hearing your colleagues out, take a few moments to stop the noise and really listen. Don’t just hear, listen! Wherever you are, there is life happening around you with all its remarkable cacophony. Single out each sound, identify it, and then keep singling out and identifying. Don’t judge the sounds as good or bad, just life happening outside of your head. Write each down. You’ll be surprised by the lack of the worry noise that was in your head a few minutes earlier.
Sight
If you don’t have the time to take in a museum, my personal recommendation, or you aren’t near a beach to watch the ocean waves, look around your space. What have you chosen to decorate your environment? Do those things bring joy when you look at them? If not, you might choose to redecorate a bit. Or you might add a flower in a vase to that otherwise over-populated desktop. Deliberately look at something that brings up good feelings. It might be as simple as the tree outside, or the color of the sky. Really think about what you are seeing and take the time to notice all the details. And then, write these down.
Smell
Concentrating on smell stimulates many regions of the brain. Smell is one of the most powerful and evocative of our senses. Memories flow freely when we focus on the scents around us. There’s a very good reason fortunes are being made with aromatherapy. Essential oils offer a quick fix for many symptoms of stress like headaches. A diffuser in the area where you encounter the most stress may alleviate some symptoms. And, if a diffuser won’t work where the stress lives, rub a little oil on your wrist for a little unobtrusive sniffing when you feel the tide of irritations rising. Also, just noticing the smells around you can transport you to other times and other places where you encountered similar scents.
Taste
Last, but certainly not least, this one bears some self-restraint. Once started, you need to be alert to comfort eating that may result in more of you than you wish. I really try to have a good meal with colleagues as often as possible during the final days of school. Potlucks are even better. Everyone has to eat lunch at some point, so arrange an end of the term potluck to savor and relish each other’s offerings. Talk about the flavors, seasonings, and what each reminds you of. Share your memories over a shared meal. Some of my happiest memories of teaching involve our faculty lounge, the whiteboard with signups and snarky comments. In addition, consider the community and collegiality of being on the same ship bailing for all we’re worth to get to that vacation.
So, take these suggestions and truly make them the moments of your choosing. Moments focused on good tangible sensory stimulation lead to minutes, which lead to hours and days to weeks to months to years. And voila! Your life has been populated with many moments that you counted and turned into moments that mattered. CAUTION!!! Once you start this habit of being in the moments of your life using your senses, you may never come back to the mundane world of endless invasive and worrisome thinking.
Preventing cheating is a challenge we all face today given not only students’ ingenuity, but also the available student tools on the internet that publish tests and answers from many, many courses. And now there is . . .ChatGPT!!!
Although it may be difficult to prevent cheating entirely, there are steps that can be implemented, reducing the impact of cheating for the student learning assessment process for online courses.
I’d like to share with you the practical tips I found from Northern Illinois’s Center for Innovative Teaching and Learning. These tips may help reduce cheating for the two most common uses of online learning assessments, which are testing and homework assignments.
Tips for testing – using learning management systems
Purposefully select assessment methods
Use online objective tests like multiple choice, multiple answer, true/false are best implemented for lower stakes assessing student learning. In fact, these types of quizzes are often best used as student self-checks in preparation for higher stakes assessments.
When assessing student mastery of course goals and objectives, objective tests may not be the best option considered among a range of methods. While an objective test can measure a student’s ability to recall or organize information, other methods are far preferable for assessing the higher order/critical thinking skills including understanding, applying, analyzing, evaluating, and creating.
Mix objective and subjective questions
Online testing using multiple choice, multiple answer, true/false, fill in the blank might be a part of a summative assessment of mastery that also includes short answer or essay questions.
These types of questions are more subjective in nature and demand a deeper understanding of the subject matter. Consider questions that allow students to demonstrate higher order thinking skills with the application of principles learned for unique situations. While mixing objective and subjective questions does not stop information sharing, it can limit the impact on the student’s final grade.
Create your own question pools
Rather than using a fixed number of items that remain unchanged for each administration of the test, consider creating a question pool using any institution’s learning management tools.
Group questions by any number of criteria including topic, subject matter, question type or difficulty of the question. I would also suggest grouping questions according to the learning outcome associated with the question.
A pool will generate an assessment with randomized questions selected by the faculty member. Pools can be created from new questions or those in existing tests or pools. Pools are most effective when there are large numbers of questions in one particular group. For example, one might have a pool of true/false questions, another of multiple choice and a third for fill in the blank.
You might create an assessment drawing a specific number of questions from each of those pool categories. Faculty can also add new questions to pools each time the course is taught to expand the variability of questions. Conversely, older questions can be removed.
Randomize questions
When creating a test using a learning management system, you are often given the option to randomize the selection of test questions as well as the order in which they appear. The benefit is that students are unlikely to get the same questions in the same sequence when taking a test.
This strategy addresses the issue of students who take a test at the same time in order to share answers. This is also relevant if faculty allows students to repeat the test. Each time this occurs, a test will be made up of questions that are randomly selected and ordered.
Limit feedback
When possible, you should limit what types of feedback are displayed to students upon completion of a test. Providing test scores is important feedback that indicates how well students have performed and should be made available. However, through a process of elimination, students may be able to determine the correct answer for each test question if their submitted answers are identified as incorrect. Or if the correct answer is provided.
Students could lose the incentive to both prepare for testing or to seek correct answers by reviewing lecture notes, assigned readings, or through a group discussion after completing tests. Thus, faculty might reconsider whether to include ‘Submitted Answers’ as an option to be displayed to students.
This is especially relevant if faculty have allowed students to repeat tests. Each time a test was taken, students could attempt a different answer for a test question that was previously graded as incorrect. Correct answers to all test questions could eventually be accumulated and passed on to other students, or to students of future classes. Or answers could be posted to some online site where students can access exams from a vast number of courses and subjects.
Set timer
We have to recognize that students taking an unproctored exam are free to use open book/notes. So you might decide to use time limits if allowed in the learning management system. Students who adequately prepared for a test may well be less likely to rely on open book/notes compared with students unprepared for testing. By setting a test with an expected completion time, unprepared students could have the most to lose as they spend time going over material, and risk not having sufficient time to respond to all the test questions.
Display questions one-at-a-time
If a test has more than 5 questions, do not choose the ‘All at Once’ option for displaying all the questions on the same screen. It is quite easy for students to take a screen capture of the displayed questions and share them with other students. While students can still screen capture pages with single questions, or even type them into a document, it is more time consuming and unwieldy.
Tips for homework assignments: assessing student progress and mastery
Create application assignments
Create assignments that require students to apply essential course concepts to a relevant problem. This encourages students to seek relevant information beyond the assigned readings and lectures and conduct independent research by identifying credible sources to support the development of their assignments.
Students can be required to report their progress on a regular basis through email, or through the journaling assignments offered in any Revel titles. This documentation makes it easier for faculty to see the development of a student’s work from inception to completion. In addition, it may possibly identify unexplained gaps that could occur if students used the work of others and claimed it as their own.
Faculty can add input at any point in this process to provide guidance, and perhaps suggest new directions for students. Both documentation of progress through regular status reporting and occasional faculty input can add a greater level of scrutiny to students. This can make it more difficult to pass off the work of others as their own. I use this method in my psychology courses by using my learning management system’s Discussion Forums. I require responses that use proper APA and documentation as well as student to student comments.
Create group assignments
Create group assignments that require students to interact with group members regularly. Groups can be made responsible for determining the functional roles for each member, establishing a mechanism for accountability (i.e., submitting weekly progress reports), and sharing drafts of individual progress on a group project. For a project to be truly collaborative, each group member should be familiar with everyone else’s work, and be able to describe how every group members’ contribution supports the whole group assignment.
Students who are using the work of others may not be able to adequately describe the significance of their ‘own’ work, or how it contributes to the group’s overall project. Group projects for me have been improved with online students using the Revel tool, Shared Media. I’m able to group students and have them submit a shared document or recording for evaluation.
Create assignments that require presentations
Conduct asynchronous online assignments for class presentations. This is easily accomplished with the same Shared Media tool in Revel. I have been using this video upload tool for over 13 years with my public speaking students.
Students may be asked to submit a progress report or use a Journal to reflect on what they have learned in the past week that supports work toward the presentation. You might consider using a discussion forum for these progress reports where classmates can contribute to one another.
To further scrutinize work on the presentation, students may be asked to include time for questions and answers. Students who have developed the presentation should be comfortable answering a range of topic-related questions from an arranged audience. I required my speech students to have an audience of 7 adults and include a Q&A that is captured on video as well as their speech presentation.
Check for plagiarism using SafeAssign
SafeAssign is a remarkable plagiarism prevention tool that detects matches between students’ submitted assignments and existing works by others. These works are found on a number of databases including ProQuest ABI/Inform, Institutional document archives, the Global Reference Database, as well as a comprehensive index of documents available for public access on the internet.
SafeAssign can also be used to help students identify how to attribute sources properly rather than paraphrase without citing the original source. Thus, the SafeAssign feature is impressive and effective as both a deterrent and an educational tool.
Using any of the Writing Assignments in the Revel tool can have this Safe Assign evaluate any submission for plagiarism.
Use discussion assignments
Creating Discussion Board assignments require students to demonstrate critical thinking skills by responding to a relevant forum topic.
You may also design a rubric that is specific to the Discussion Board assignment and develop questions that require students to respond to every rubric category.
Having assignments that are very specific makes it more difficult for students to use portions of a previous term paper or other sources.
Include academic integrity policy statement in the course syllabus
As faculty we need to include a policy statement regarding academic integrity in the course syllabus.
In addition, reiterate academic policies for students taking an online course and clarifying guidelines for completing tests and assignments so that students are not confused about what they can and cannot do.
While this, in and of itself, may not be sufficient to change behavior, its acknowledged presence in the syllabus acknowledges a commitment to honesty in the academic arena. It also establishes the clear expectation that academic integrity is an important principle to live by.
Faculty may also choose to mention this policy using the ‘Announcements’ feature in any of your learning management systems, or while conducting a live web conference session.
Learn More
Preserving academic integrity is an ongoing challenge for traditional face-to-face, blended, and courses that are entirely online. While a number of expensive technology solutions, such as retinal eye scanners and live video monitoring have been developed to prevent cheating in online courses, the practical recommendations above can reduce the impact of cheating on assessing student performance online.
The COVID-19 pandemic in early 2020 revealed challenges for students and teachers worldwide. By the end of the 2021 school year, students in K-12 were months behind in math and reading. Students and teachers had faced changes in schedules, new teachers midyear, internet challenges, and Zoom exhaustion.
These changes forced a sudden change in traditional teaching and learning styles. The digital transformation in education advanced exponentially, creating new opportunities for students to learn through video rather than solely for gaming.
The value of video
Teachers learned how to use videos to keep their students engaged. Video provides the much-needed flexibility and personalization to individualize learning experiences for specific student needs. Students benefit by watching at their own pace, anywhere, anytime, allowing them to stop, rewind, and play again to meet their needs.
Johannes Vermeer’s Woman Holding A Balance was the featured art in the October HSS eNews.
Johannes Vermeer (1632-1675) was a Dutch artist. Created c. 1664, Woman Holding A Balance is oil on canvas measuring 15 5/8” x 14”. The image is courtesy of the National Gallery of Art in Washington.
Many of you may be experiencing those end-of-term emotions ranging from relief to exhaustion. On top of all the final grades and last-minute faculty duties, it’s time to think about the next term’s classes, whether that’s a short summer session or getting a jump on Fall class designs.
Course review
If you’re a Revel® user, I suggest you examine your aggregate class data from the easy-to-access dashboard view before automatically copying the current course into the next term’s course shells. The dashboard view gives you a wealth of actionable data.
The Revel dashboard is a completely different tool for analytics than I have ever used in terms of providing numbers that reflect what was working and what needed improvement. The data helped to inform my decisions about the efficacy of the current course and implied changes I could make to the current design to increase students’ engagement and content proficiency next term. Let’s walk through what I found most helpful.
Educator Dashboard insights
The Revel Educator Dashboard provides a great deal of information in the following areas:
aggregated class data for a view of overall performance
score details to see class performance on each type of assessment assigned
struggling and low performing student gauges for quick identification and communication
assignments with due dates as well as additional details, including challenging items
settings tab showing assessment types and ways to improve the course design
Assessment data
When reviewing the assessment data, I ask myself if there are any settings or scoring policies that I might change to increase both engagement and comprehension.
The view score details section provides aggregate scores for students on each type of assessment assigned, allowing me to note assessment types that received low scores. This can indicate a lack of understanding or a lack of participation. By drilling into the details of some assessment types within the assignment view of the grades section, I might see a lack of participation rather than low scores. This could indicate I should assign greater value for these types of assessments if I feel they are sound activities for students to become proficient with the content.
Increasing the weight of certain assessments might incentivize students to complete them. Or, by allowing fewer attempts for the Revel module or chapter quizzes, students may be less likely to complete the quizzes without fully understanding the concepts they should have read before taking the quiz.
You might choose to exclude certain types of assessments next term if you feel the value is less than you wish for students to expend energy and time completing. In that manner, you might increase compliance on the assessments you feel are more robust in helping students acquire the knowledge needed to become proficient in your courses’ required outcomes.
I acted weekly based on the struggling and low activity student gauges by sending a brief email to those students and it made a dramatic difference in my classes, both face to face and online. For three years I conducted my own efficacy study by examining the effect of using this intervention strategy with my low-performing students. I opened the dashboard view early Monday mornings after the Sunday due dates and dropped each student an email stating I noticed they were having some issues in completing their work in Revel the previous week. I would tell them to contact me if I could be of assistance with anything.
This simple, very quick intervention was so telling during COVID-19 when students would email me back and share things like they had little connectivity at home with four siblings using the same Wi-Fi, or they had lost their homes and were in the process of moving. Issues that I had no ability to resolve yet tugged at my heart. However, I could put skin on the computer by letting my students know I cared and connected with their struggles. Even if the student was simply slacking, they knew I was an active presence in the online classroom. We know from research on distance learning that human connections between students and teachers, and between peers, are often the variable that increases persistence to completion.
Over our three years of COVID-19 I have seen an increase of slightly more than 25% retention in my online classes and 13% in my face-to-face classes. Apparently, being engaged with the content outside of class was equally important as in-class presence.
Deeper course analysis
The next question I pose for myself relates to what I can change or renew for even greater success next term.
When you scroll beneath the dashboard to the assignments and you see challenging items, this means there are questions on the quizzes that many of your students did not answer correctly on the first quiz attempt. This could indicate the concept is difficult to grasp by simply reading the material.
When you dig deeper, you can see the exact question/concept where students struggled. This information has prompted me to add some of my own content to the Revel material to increase students' understanding. For instance, with psychology, operant and classical conditioning are concepts often confusing for intro to psych students. I have added material in my LMS, class, or Revel by using the highlighting and sharing a note feature to increase students’ understanding of that difficult concept.
I also like to look at overall trends in the term by scanning the dates, the scores, and the participation. This can inform me about seasonal changes in students’ performance such as midterm slump, spring break fever, or those times in any of our terms where students’ performance historically declines.
Student engagement tactics
Interventions to increase student engagement might include reducing the number of assessments or using more active engagement assessments, such as asking students to present or to work collaboratively to engage them more fully.
If you go to the resources tab and open your book, you can select the section you found of challenging items. Highlight that section, add a note or even a URL to create an active link in your students’ notes. You could add a TED talk, or, as I did with my psychology students, a link to YouTube of The Big Bang Theory show where the actors are using operant and classical conditioning to train their significant others. When you share notes like this, the information appears in your students’ notebooks, and they can use your notes as study guides.
Revel offers the right amount of actionable data for me to understand my students’ progress, their engagement, and where they experience challenging concepts. The platform also helps me improve my delivery, increase student success with Revel, and helps students become proficient in the learning outcomes.
