Teaching practices for your virtual classroom
Many in-person courses are now moving to virtual learning environments. Virtual learning has the same goal as face-to-face learning and that goal is to get students to engage with the material and interact with you, classmates and the subject matter. Something that will never change is the fact that instructors are what makes virtual courses […]
Students have 24/7 access to feedback with Crowdmark at the University of Auckland
Crowdmark has become widely used at the University of Auckland, albeit with a little “encouragement” from Andrew Eberhard, faculty member in the university’s Business School and Director of its Business Masters program. Key in this was getting academics at his institution to see just how “easy and great” it was to use. The university had digital […]
Georgia Tech uses Crowdmark for distance education exams
“It was all unicorns and rainbows”. That was the half-joking response of Dr. Greg Mayer, Academic Professional Associate in Georgia Tech’s School of Mathematics, when asked what his initial reactions were when first using Crowdmark. Dr. Mayer has a long history of innovative pedagogy, marked by his involvement in Georgia Tech’s Dual Enrollment high school math program. […]
New feature: Course roster and team management
This feature will allow instructors to set up their students and team for a course once, rather than for each assessment. Crowdmark will automatically handle students who have added or dropped the course each time you update the roster. When creating an assessment you will still have the flexibility to select which students, sections, and […]
Immersive technology in higher education
To what extent will augmented reality and 3D printing affect post-secondary teaching and learning? Over the past year, academic instructors and IT teams at Florida International University, Hamilton College, Syracuse University, and Yale University participated in a research project commissioned by Educause and Hewlett-Packard to explore the best practices for adopting and integrating immersive technology […]
How I use Crowdmark outside of STEM
This January I had the opportunity to develop and teach a course in applied social media at Centennial College’s Bachelor of Public Relations Management program. The notion of crafting, and teaching to, a fresh curriculum was daunting at first, but I had the support of both wonderful colleagues and Crowdmark. Throughout the course students were […]
Introducing the Crowdmark Portfolio for Students
On August 8, 2018 Crowdmark will release a major new feature for students—the Crowdmark Portfolio. This means students will be required to access all of their Crowdmark assessments in one place by signing in to our secure platform. What does this mean for instructors? After you distribute an assigned assessment or return a graded assessment […]
Statement of goals and choices
Let’s face it: many students go through the motions when completing an assignment. These final products are generally composed of a surface-level analysis of the prompt and a checklist of content meeting the minimum viable standards mentioned in the rubric. To encourage students to focus on the process—rather than the result—of assignments, a growing number […]
Bridging the math gap in biology
The ability to effectively use mathematical models in understanding and communicating the foundations of biology is a waning skill among of freshmen students in the United States (PCAST, 2012). Worrying that this “mathematics gap” may dissuade students from pursuing a degree in a STEM field, a consortium of educators at six liberal arts colleges and […]
Check in early and often: Set students up for success
An overarching criticism of student evaluations of teaching (SET) is they are often a measure of student satisfaction rather than learning outcomes. There are myriad other criticisms. Evaluations are regularly completed at the end of the course, so professors have little opportunity to adjust their instruction, the feedback is often more negative for women and […]
Digital storytelling in STEM
Students in the Faculty of Science at the University of Technology Sydney are using digital media platforms to enhance their comprehension of—and communication skills in—scientific foundations. A lecturer in the Faculty of Science, Jorge Reynas saw an opportunity to improve the way his students learn and retain information through Learner-Generated Digital Media assessments (LGDM). Starting […]
Interview with Robert Craigen, University of Manitoba
Robert Craigen is one of many instructors across Canada using Crowdmark to provide his students with more formative feedback. Robert’s first experience with Crowdmark was during the 2012 Canadian Open Mathematics Competition (COMC). This was the beta test of Crowdmark’s grading platform, where Robert and 146 other graders across Canada used the platform to grade […]
Education through exploration
Ariel Anbar’s students learn science by exploring the unknown rather than mastering the facts. As the director of the Centre for Education Through Exploration (ETX Center) at Arizona State University, Anbar aims to disrupt the traditionally siloed and rote teaching approaches of STEM education by promoting the pedagogy of science exploration through engaging and adaptive […]
Automatic grading to improve scientific literacy
Educators at Wake Forest University are developing an automatic feedback platform to improve the scientific literacy and communication skills of STEM undergraduates. Strong communication skills are becoming a necessity for pursuing an academic or professional career in the STEM industry; however, a disproportionate number of students are entering the workforce with inadequate writing skills. Over […]
Managing ePortfolios
People regularly organize myriad aspects of their lives—careers, projects, and finances—into portfolios for easy reference and reflection. It is a valuable habit and one that educators are introducing to students at an early stage through ePortfolios. An ePortfolio is a cloud-based repository and assessment tool where students—in any academic discipline—may upload and organize course assignments […]
Approaching student evaluations
Student evaluations stir up a lot of emotions within faculty, administrators, and students. No one argues with the concept of student evaluations being necessary measures of teaching competency and student learning, but their effectiveness and reliability in doing so is contentious. Part of this is due to nearly every institution administering the evaluations with their […]
Classroom tickets: A way to motivate preparedness?
Want students to arrive in each class prepared and ready to engage with the material? Consider charging a ticket—a brief academic prompt—for admission. In order to enter or exit the classroom, a growing number of instructors are having have students submit a brief response relating to the course readings or information presented in lecture. These […]
Improving grading efficiency with Crowdmark
Andrew Eberhard, a Professional Teaching Fellow at the University of Auckland’s Faculty of Business and Economics, is responsible for teaching and grading thousands of undergraduate students each year. While Andrew has a genuine passion for teaching—earning five awards of excellence since 2011—he quickly found grading to be a logistical nightmare. When preparing to grade an […]
Assessment is an arc, not episodic
Twenty-five years ago, the American Association for Higher Education (AAHE) published the “Principles of Good Practice for Assessing Student Learning”, a framework which continues to shape and influence pedagogy in academic environments across the world. The framework posits that instructors and administrators must embrace assessment as an arc, rather than an episode, aligning them with […]
The benefits of failure
You’re sitting in class eagerly anticipating the return of your latest exam. The professor approaches your desk, hands back your booklet and your heart sinks as you gaze upon the scarlet letter in the top-right-hand corner. Sound familiar? It’s a feeling most of us have experienced and can still vividly recall. It may also be […]
Is grade inflation an assessment issue?
Grade inflation is a result—rather than the cause—of poor assessment practices in higher education. In a recent study from Penn State Erie, The Behrend College suggests that some instructors who believe they are using “badly designed or poorly executed assessments” are more likely to engage—either consciously or subconsciously—in lenient grading as a corrective measure. To […]
Motivate students with data and feedback
A recent study by the Michigan School of Information, in collaboration with Blackboard, sought to determine whether providing students with personal performance data and motivational feedback at specific times throughout the semester will improve study habits and GPAs. To test this hypothesis, 47 student volunteers were enrolled in a simulated classroom environment and divided into […]
Taking a student-centered approach to data
Younger students in higher education have grown up in a world of personalized two-way communication through social media. In exchange for their personal data, platforms like LinkedIn provides students with tailored information on internships, Facebook suggests them curated friends and events, and Twitter provides curated news. According to a recent Ellucian survey, some students are […]
Watson: It’s elementary and higher ed
Photo courtesy of IBM Watson IBM is partnering with Blackboard and Pearson to bring its Watson technology to K-12 and higher education. While products from the partnership will not be widely available until 2018, the technology is expected to focus on improving student learning and graduation rates. Many expect IBM to accelerate the digital transformation of […]
EQAO moves forward with online OSSLT despite cyberattack
A cyberattack compromised the online pilot of a province-wide standardized test in Ontario on October 20, 2016. Originally thought to be the result of rampant technical and server issues, many students were unable to access the assessment which was eventually cancelled later that day by the administering Education Quality and Accountability Office (EQAO). Over 190,000 […]
Digital learning technology’s increasing role in the classroom
Over 80% of college students report that technology is improving their grades and study habits. In August 2016 McGraw-Hill and Hanover Research surveyed 3,311 students at the associate’s, bachelor’s, and graduate level to assess their digital study habits and the role technology has in their education. The findings demonstrate that mobile and digital learning technology […]
World university rankings: Measurements of teaching or research?
Reputation is an invaluable asset which colleges and universities use to recruit the best and brightest students from across the world. University rankings explicitly or implicitly influence the decisions prospective students—and their parents—make in choosing where to study. One of the most important components of global rankings is teaching; an element which is under increased […]
Want to improve your teaching? Become a student again
Photo courtesy of KMo Foto Looking for ways to teach more effectively? Try walking a mile in your students’ shoes. A growing trend amongst professors and teaching assistants is completing their own assignments before or alongside their students in order refresh their pedagogical framework and better engage their students. A common critique of post-secondary assignments is […]
Improving feedback from high stakes testing
High stakes testing is a ubiquitous aspect of American education. At the macro-level their results have significant influence on education policy and funding, and at the micro-level they shape a student’s academic future. Unfortunately, while the assessments provide meaningful insights to administrators they fail to provide the same formative feedback to the students and instructors […]
Educational priorities of the Bill and Melinda Gates Foundation
During his keynote speech at the ASU+GSV Summit, Bill Gates outlined the three educational platforms his foundation will be prioritizing to best serve the current and future generation of American students. The latest high school graduate rates in America are at 81%–the highest levels in over 6 years—and are expected to reach 90% by 2020. […]
New SAT is high stakes for students, college board
The new version of the SAT was administered for the first time on Saturday March 5, 2016 to over 450,000 students. The stakes are high for students hoping to be accepted to their preferred colleges, but arguably even higher for the College Board, the SAT’s developer. The College Board made significant revisions to the SAT […]
Benefit of graduate student instructors
Photo courtesy of University of the Fraser Valley A recent study by researchers at Stanford and Harvard University has found that first-year courses taught by graduate students result in significant benefits for both undergraduates and the graduate instructors. To determine the value of graduate-student led courses, a longitudinal study of public universities in Ohio tracked the […]
Digitizing student transcripts
Conventional college transcripts are similar to resumes providing evidence of enrollment and grades. However, outside of the awarded degree, they are unable to provide tangible evidence of knowledge, skills, and experience. This may change soon through the Comprehensive Student Record Project. If successful, the conventional college transcript may become more similar to a LinkedIn profile. […]
Standardized testing in Ontario universities
This fall, several Ontario colleges and universities will be administering entrance exams that will assess the literacy, numeracy, and problem-solving skills of incoming students. Upon graduation, members of this fall 2016 cohort will take the assessment again to determine whether post-secondary institutions are preparing students with the skills and competencies required for the workforce. If […]
Female students evaluated on attractiveness in higher education
A 2015 study has found the physical attractiveness of female students to be a statistically significant implicit factor in grade results. For male students there is no significant relationship between attractiveness and grades, and the results were consistent regardless of faculty members’ gender. The study was conducted at Metropolitan State University using data from 5,394 […]
The rise and fall of the Common Core
The introduction of the Every Child Succeeds Act (ECSA) on December 10, 2015 effectively signified the end of the Common Core standards in the United States. Introduced as a common academic benchmark for English and mathematics in K-12 education, the Common Core standards garnered bipartisan political support and were adopted by 45 states. This initial […]
Holistic evaluations through contract grading
In order to emphasize the learning process over grades, a number of post-secondary instructors are foregoing traditional grading rubrics in favour of contract grading. Students are still evaluated based upon the demonstration of their knowledge and skills but instead of basing the evaluation on a single essay or test, contract grading takes a more holistic […]
Common Core’s unfulfilled goal
The Common Core Standards were introduced in 2010 in an effort to ensure K-12 students across each of the 50 states are being taught and evaluated using a common standard. Preliminary results from the first administrations of Common Core-aligned testing are showing that overall student scores have improved. Unfortunately, due to a number of states […]
Applied evaluation in New York
High schools in New York State are providing their students with opportunities to earn their diplomas through research projects and oral evaluations as an alternative to standardized tests. Research has shown that these evaluation methods administered under the New York Performance Standards Consortium yield higher graduation and college-enrollment rates. The consortium evaluations are designed to […]
New York’s proposed teacher evaluation has the wrong criteria
Photo courtesy of Ivan T New York’s proposed reform on teacher evaluation policies is heading in the opposite direction of other states’. The legislation, which was approved in March and has until June 30 to be approved, will have the student performance on standardized tests account for one half of teacher evaluations. The effects of this […]
The panopticon of predictive analysis
There is no question that we live in a world of big data. As users of social media, every comment we publish, connection we establish, locations we check into, and pages we visit are mined to present us with tailor-made advertisements. As consumers, every purchase made with a credit card is analyzed to determine spending […]
Over 1,000,000 pages evaluated on Crowdmark
When we started Crowdmark in 2012, I never imagined that we would be building a solution to change the dialogue between students and educators. We were simply building a platform to ease the pain of grading thousands of pages of handwritten student work for a math competition. Fortunately our solution resonated with educators and our […]
Competency-based education 2.0
The University of Texas offers a unique approach to the model of online competency-based education in order to position it as a legitimate form of education. As it stands, the structure of competency-based education is widely regarded – and implemented – as being completely online, self-directed, and self-paced. As a result of this, competency-based education […]
No more hunt and peck
Santa Clarita Valley students will be trading in their pencils for keyboards on their standardized tests this year. One of the key reasons for this transition is to help students become more familiar using QWERTY-standard keyboards. While most students are digital natives with access to computer technology since early childhood, their reliance on texting through […]
University of Maryland punts on athletics reform
Photo by Daniel Hartwig Football scandals have, for better or worse, become part of the new normal on large college campuses: sexual abuse at Penn State, brain damage at Michigan, and cheating at UNC. In response, the University of Maryland has tried to combat a bad image in two ways: first, by offering “lifetime scholarships” to its student athletes, rather than limiting the life […]
Finnish schools: Great education policy? Or great economic policy?
When I was 17 years old, I ‘studied’ abroad (it was only for the summer) in Finland. This is an experience that my mother has never let me forget, mainly because I found Finland to be such a wretched place that I came home a month early. It’s always a surprise to me, then, when […]
Why the turnaround on the Common Core?
Although the standardized tests are months away, students, parents, teachers, administrators, and politicians are already mired in debate over the Common Core Standards (CCS). Websites are popping up to help teachers find and adjust to new lesson plans, new standards, and new materials. While some teachers favor the new standards, others increasingly oppose them, as do education luminaries like Diane Ravitch. But regardless of your stance on their efficacy, […]
Where are the humanities going, where have they been?
The debate over the place of the humanities in the modern curriculum continues without any sign of resolution. We’ve seen lamentations for the death of the humanities a call for the elimination of popular programs (like business schools) to save the humanities; a rebuttal that the humanities are alive and well😉 and that uncertain savior, the hybrid discipline of Digital Humanities. And this is only a small selection of available topics. And yet there’s more […]
Tried and true? The new face of assessment
US educators increasingly recognize that students have differing needs and goals for education. The most controversial may be compentency-based learning, which offers instruction and credits based on skill, rather than on time spent in the classroom. Several companies are capitalizing on this idea to offer new means of assessment. Among the most popular is the portfolio assessment, which allows […]
Career education starting earlier
A major reference point for many educational writers is the 1950s. In the US, this was an era when you didn’t need any education after high-school: with strong unions and the post-wat manufacturing boom, many men went to work in trades, while women either stayed home or worked in nursing, schools, or offices (think Mad […]
‘Simple’ isn’t always ‘right’: why more educated workers doesn’t make a more equal society
Photo courtesy of Texas A&M University Commerce Last week’s New York Times featured an article by Eduardo Porter that laid the historical background of the US educational landscape out quite clearly, and yet drew a surprisingly inept conclusion. Porter rightly points to a longstanding American goal of educating its populace (mainly future citizens), and draws attention to a number […]
Following the leader?
By now you’ve probably heard of William Deresiewicz, the controversial former Yale professor whose new book, Excellent Sheep, has been making the usual promotional rounds. Before you ask: no, I haven’t read it (it was only released last week). I am going to do what I always tell my students not to do, which is criticize it anyway. As I understand it, the […]
Foreign students are a cash cow for universities — and a threat to some
Two stories about foreign students made the Canadian headlines this week. This is unusual, both because most of the time Canadian news outlets pay little attention to who is actually attending their universities, and also because I think most Canadians consider themselves open to immigrants (unlike, say, their southern neighbors). But this seems to be about to change as more […]
Rag in A major
Controversial columnist Jeff Selingo made his own headline this week by suggesting that colleges eliminate majors. Why? Well, they’re so last century. Since I suspect that I may know more about curricula than Selingo (I have certainly been teaching longer), I’ll be honest: I think that this is not a particularly helpful idea, and since he doesn’t […]
Promises and pitfalls of predictive analytics
Predictive analytics has long been seen as the next big thing in education. Several different learning-management systems have the option of analyzing student progress included in them; there are also standalone systems (see “read more” for some of these options). The allure of being able to pinpoint which students need further assistance is obvious, although […]
Assessment without exams
No one likes testing. Students don’t: some get too nervous, others don’t like to study. And their teachers and professors don’t: good exam questions are hard to come up with, hard to recycle (thanks to online exam repositories), and a huge pain to grade. Unfortunately, students are also learners, and they need to be assessed […]
Computers in the classroom are here to stay
Photo by Wikimedia / original article Advances in technology are generally seen as a good thing in our society. Remember the adding machine? Remember the calculator? For the most part, these tools have moved aside for newer models (such as the smartphone). But there are still a few last frontiers where technology is seen as, at […]
Lovers, dreamers, students
Students are often divided up for statistical purposes. When they apply to school, they may be asked to select a race/ethnicity. They will be asked for their geographic location and parental income. While they are at school, various offices will be categorize them by gender, roommate preferences, degree progress, and major. Sallie-Mae, a large American […]
Minerva vs. mentor
It’s not news that the university (as an institution) is in trouble. This headline has been making the rounds for years, as prices creep up, student employment drops down, and well-publicized scandals (bankruptcy; child abuse; mistreatment of athletes) seem to be on the rise. Most attention has been focused on a few discrete issues, such as student debt and adjunct faculty. But one entrepreneur […]
College tests announce major changes
In a turn of events that perhaps isn’t surprising, the ACT announced in June that it would revamp its tests. This move follows the ACT’s assessment rival, the SAT, who announced a facelift for the test in fall 2013. The SAT had previous announced changes in the types of reading and vocabulary that students would […]
Can personality characteristics be assessed?
Angela Duckworth has been getting a lot of press lately. The researcher, who is best known for her pioneering work on ‘grit’, is at the center of a new controversy on whether it is appropriate to evaluate students on non-academic qualities. This is surprising for two reasons: first, because Duckworth’s work is not new (her […]
The promises of adaptive learning
Adaptive learning is polymorphous. Some of it is familiar to all of us from school, even from a pre-digital age. For example, I remember the glorious two weeks of third grade when a substitute let me learn fractions from a book with a classmate named Ryan while the rest of my class moped through their […]
State achievement tests incite controversy in Texas
The Texas state achievement tests have been given annually for the past three years. Although schools were expected to post improvements in results, so far lower-income districts have fallen further behind upper-income districts. Suggested reasons for this discrepancy vary: the education commissioner claims that instructional content has not increased in difficulty to match test content, […]
How useful are PISA scores? It depends what you’re measuring
Declining PISA scores across Canada should be a concern to everyone, not just educators, says a new report from think tank The C. D. Howe Institute. The study found that Canadian students’ average score has been steadily slipping, but its author draws particular attention to the downward trend in math and science. Quebec was the […]
We don’t need no educators
Photo courtesy of Roger Blackwell In Ontario this past week, the big news was the election of a Liberal majority to Parliament. This led to a wide-ranging debate on various campaign promises, including the promises about (de)funding higher education. Ontario’s situation mirrors that of many US states, the UK, and Australia: per-capita spending per student is doing down, tuition […]
Retired MIT writing professor questions value of SAT-Writing test
Les Perelman has written a program that can mimic a perfect-scoring SAT essay. Unfortunately, it’s gibberish. His software, appropriately called “Babel” after the famous biblical tower, can generate an SAT-length essay in under a second. It uses a combination of length and “SAT words” to receive high marks from automated essay-grading software. Content is not […]
Students in the UK find that their educational experience does not meet expectations
A survey of over 15,000 UK undergraduates found that the majority of students attending universities in England were unsatisfied with the value of the degree. This is an abrupt departure from earlier measures of satisfaction (undertaken in 2012) and contrasts with the judgment of students in Scotland, where university is free for many students. Over […]
Crowdmark named “Most Innovative” at SIIA Conference
Crowdmark was recently named the “Most Innovative Product” at the SIIA awards in San Francisco. Our collaborative online grading platform was chosen among 50 applicants by both industry leaders and educators in classrooms across the country. “Crowdmark is very pleased to have been chosen as Most Innovative by the attendees at the SIIA Education Industry […]
PISA tests: Equal assessment or creative block?
It’s the middle of 2014, and that means that educators’ eyes are turning to the big hurdle of the next academic year: the newest round of PISA (Programme for International Student Assessment) testing. This test, which is administered by the OECD, takes place every three years with a rotating group of topics. Students in countries […]
Better testing with Crowdmark: Using open-ended questions in large courses
Alfonso Gracia-Saz, an instructor who teaches a 1,000 student calculus course at the University of Toronto, explains how Crowdmark allows for testing of higher level learning. “When doing a mega course like this one and designing the tests, there’s always the concern of ‘Am I going to be able to grade this question?’ and ‘How […]
“How would you feel if you could no longer use Crowdmark?” An Engineering professor reports
Dionne Aleman, an Associate Professor of Mechanical and Industrial Engineering at the University of Toronto, explains how she would feel if she could no longer use Crowdmark. “It would be a travesty if we were no longer allowed to continue using this tool.” Professor Aleman explains how Crowmdark boosts her productivity and improves the quality […]
University students share thoughts on digital grading
Have you noticed how even as more students show up with a laptop in hand, some of them still use a notepad and a pen? They just can’t seem to choose. That’s exactly what’s happening with grading. Yet regardless of the format of assignments, test results and types of questionnaires, certain common themes emerge when […]
New features: Freeform scores, text annotations, upload status list, and extra exams
Freeform scores You can now enter any number as a score (including fractional points as decimals). With the new keypad, type or tap any number and hit Enter (or OK on the keypad) to submit. Text annotations Provide contextual, formative feedback anywhere on the page. Double-click or double-tap to create a comment. Comments can easily […]
Opinion: The New School: Separate, unequal — and unashamed?
You don’t become a pundit because of non-controversial ideas. In his interview with The Atlantic, University of Tennessee Professor of Law and Instapundit blogger Glenn Harlan Reynolds offers his opinions on the American educational landscape from kindergarten through university. Yes, this is an interview, not an article — yet he still provides no support for his ideas, […]
Introducing freeform annotations and keyboard shortcuts
We’ve added two new features to boost and enrich your grading experience, with efficiency and better student feeback in mind. Freeform annotations Feedback is no longer limited to text comments. Check, circle, and write on exams to provide your student with rich, contextual feedback. It’s easy to draw and delete annotations as you go—one click […]
Crowdmark hires Lyssa Neel as Chief Operating Officer
Crowdmark hires Lyssa Neel as Chief Operating Officer Dr. Lyssa Neel, formerly with MaRS Innovation, has been recruited to join the Crowdmark team as Chief Operating Officer. Since the launch of Crowdmark through the University of Toronto Early Stage Technology (UTEST) incubator, Dr. Neel has been the key business advisor to founders Dr. James Colliander […]
Crowdmark presents at LAUNCH
Crowdmark was demonstrated at the LAUNCH Education & Kids 2013 event in Mountain View, California. We thank Jason Calacanis and the Launch team for the opportunity. Here’s a video of the Crowdmark presentation: https://www.youtube.com/watch?v=z9XM4fyY3z4
Crowdmark to save teacher marking time and government dollars
Ed-tech start-up completes successful EQAO and Canadian Open Math Challenge pilots TORONTO, June 11, 2013 /CNW/ – Crowdmark Inc., a Canadian education technology start-up, is positioned to save cash-strapped Departments of Education millions by making massive-scale testing more efficient. Crowdmark has raised $600,000 in seed funding through the University of Toronto Early-Stage Technology (UTEST) program, MaRS Innovation and U […]
K-6 teacher testimonials validate Crowdmark
In May, we ran a successful Crowdmark EQAO marking pilot at Golf Road Junior Public School. Joseph Romano, who led the pilot at the school, wrote that Crowdmark cut teachers’ marking time in half and provided a smooth, easy-to-use interface to facilitate both individual and group marking from home. Through the demo, we received additional feedback […]
Independent schools and K-12
I was an independent school teacher. In my career, I’ve taught grades 7-12, English, Economics, Political Science, American Studies, and more. I was a house director, supervising up to 80 boys in the residence, coaching a sport every term, doing campus supervisory duty, even selling hot dogs every weekend with the boys to raise money […]
Idea to prototype
Inspiration The inspiration for Crowdmark was the logistical nightmare of grading the 2011 Canadian Open Mathematics Challenge (COMC). Imagine banker boxes and banker boxes, each containing FedEx envelopes containing tens of exams, with each exam containing 14 pages of hand-written answers to mathematics contest problems. We used skilled human volunteers to assess 70,000 pages of […]