Typing Pilot Checklist: 3 Artifacts to Judge Instead of WPM

A typing pilot should be run as a curriculum review, not an efficacy study: judge lesson sequence, work samples and technique rather than six weeks of words-per-minute data. Meta Typing Club offers more than 2,400 lessons organized by language and skill, and sends its full lesson sequence to any district for a crosswalk before purchase.
TL;DR: Run the pilot as a curriculum review, not an efficacy study. Crosswalk the vendor's lesson sequence against your grade-band targets, collect three instructional artifacts, write the keep, scale or drop rules before week 1, and treat any six-week speed gain as the least informative number in the file.
Fit and impact are different questions, and only one is answerable in six weeks
Impact asks whether students improved because of the product. Fit asks whether the product teaches what your curriculum document says you teach, in a sequence a classroom teacher can run on a Tuesday morning without a specialist in the room. Your pilot window can answer the second question well and the first one badly, and the committee that confuses them ends up recommending whichever product produced the prettiest chart.
What a six-week window can actually establish
Four things, reliably: whether the sequence reaches your grade-band target, whether teachers ran it without extra planning time, whether students used correct technique when nobody was standing over them, and whether the reports were readable to people who do not work in technology. Those are fit findings, and they hold up in a curriculum review committee.
The number someone will wave at you
A class practicing 10 minutes a day for six weeks has logged roughly five hours of new practice. Any beginner improves after five hours of practice on almost any keyboarding product, including free ones, so a speed gain inside the window tells you that children practiced, not that this platform teaches. According to Digital Promise, districts should draft a success statement with specific benchmarks before implementation, built with educators and leaders rather than after the data arrives.
Write down what would make you say no before you see a single dashboard, or the dashboard will write it for you.
Borrow the adoption protocol you already own
You do not need a new evaluation framework for this. Your district already runs one for textbooks, and it asks better questions than most edtech pilot templates.
Five criteria, translated for keyboarding
According to the California Department of Education, a review committee applies five criteria: alignment with adopted content standards, program organization, assessment, universal access, and instructional planning with teacher support, with piloting named as the next step in the selection process. Translate each one into a typing question and name the artifact that answers it.
| Adoption criterion | The typing question it becomes | Artifact that answers it |
|---|---|---|
| Alignment with adopted standards | Does the sequence reach our grade-band target by the grade where we published it? | Vendor lesson map beside your benchmark table |
| Program organization | Can a teacher run 10 minutes with no preparation the night before? | Teacher log from week 3, one line per session |
| Assessment | Does the report show accuracy next to speed, per student, per class? | A real class report from your own pilot section |
| Universal access | What happens for a newcomer, a student with an IEP, a left-handed second grader? | Three named student cases written up by the teacher |
| Instructional planning and teacher support | What does a teacher get when a student stalls at 12 words per minute? | Help documentation plus one support ticket you file yourselves |
Who sits on the committee
The same guidance says the committee should include parents, administrators, teachers at all grade levels, English learner programs and programs supporting students with disabilities. For a typing review, add the person who will own the accounts, because whoever creates and resets them inherits the workload for three years.
A typing platform reviewed against your textbook criteria produces a recommendation your board already knows how to read.
Crosswalk the sequence against your grade bands
This is the artifact the whole review turns on, and it takes a curriculum person about two hours per grade band to build. On the left, your published targets. According to Wisconsin's Department of Public Instruction, the widely used convention is 5 words per minute times grade level. According to Arlington ISD, the published ladder is grade 2 at 5 WPM, grade 3 at 15, grade 4 at 20, grade 5 at 25, and 50 by high school, all at 80 to 100 percent accuracy. Our guide to setting keyboarding benchmarks a district can defend covers how to choose between them. On the right, the vendor's lessons.
One row of the crosswalk
Grade 3, target 15 words per minute at 85 percent accuracy by May. Which lessons cover the home row, which introduce capitals and punctuation, how many sessions the sequence needs to get there, and what the platform shows a teacher when a student is three weeks behind that pace. Meta Typing Club has more than 2,400 lessons organized by language and by skill, starting at the home row, with homework assignable to a class, to several classes or to named students, optional due dates, and per-student completion, accuracy, words per minute and stars. The dashboard reports words per minute only, so if your benchmark table is written in characters per minute, you convert it yourself before the meeting.
Where our sequence will not match yours
It is built by language and skill, not by your grade bands, and nobody has mapped it to your scope and sequence. You will do that mapping. Any vendor who tells a curriculum director their sequence already aligns to a district document they have never read is selling, and you should ask them to point at the row.
The crosswalk is the deliverable; the pilot exists to test whether the crosswalk survives contact with third graders.
Three artifacts, collected while the pilot runs
Collect these and nothing else. Every additional data request buys resentment from the teacher who agreed to help you.
- The lesson map with dates. Which lessons the class actually reached each week, exported or copied by hand. It shows pace against the crosswalk, which is the whole point.
- Two dated writing samples. The same 10-minute typed prompt in week 1 and week 6, saved as student work in your own drive, not as a platform score. A committee that can read two paragraphs by the same child learns more than it learns from a speed chart.
- A technique tally. Ten minutes of observation at minute nine of a practice session, when the novelty has worn off. Tally five behaviors: eyes on the keyboard, both hands on home position, wrists resting on the desk edge, thumb on the space bar, and whether the student restarts after an error or plows on.
Technique earns its place in the file because method appears to matter more than exposure. According to Donica, Giroux, Kim and Branson (2021), a study that compared two keyboarding instruction methods over two years across 592 and 714 elementary students in grades 1 through 4 found differences in speed and technique between approaches. A classroom that is on the platform daily and typing with two index fingers has produced usage data and no skill.
| Artifact | Who collects it | Time cost | Supports a claim about | Does not support |
|---|---|---|---|---|
| Lesson map with dates | Pilot teacher | 2 minutes a week | Pace against your published target | Whether the pace was caused by the platform |
| Week 1 and week 6 writing samples | Pilot teacher, stored by the school | 20 minutes total | Output length, fluency, what typing costs composition | Growth beyond this class of students |
| Technique tally | Coach or curriculum director | 10 minutes per section | Whether correct technique is being taught or tolerated | Long-term retention after the pilot ends |
Usage data proves a subscription was used; technique and work samples are the only pilot evidence that survives a skeptical committee.
The keep, scale or drop meeting
Write the decision rules in the same document as the crosswalk, before week 1, and give a copy to the pilot teacher so nobody is surprised in April. A workable set: keep if the sequence covers at least 80 percent of your grade-band targets and teachers ran it without added planning time; scale if the technique tally also moved and the reports were readable to a principal; drop if reaching your targets needed teacher-built supplements, because that cost recurs in every building you scale to.
Then handle the evidence question before a board member finds it. According to ESSA, there are four evidence tiers, with Tier 4 defined as demonstrating a rationale based on high-quality research findings, the weakest of the four. A typing platform with no efficacy study is a Tier 4 rationale at best, and ours is no exception. Say that in the recommendation, in your own words, with the reasoning that makes it defensible: typed assessment is required, transcription interferes with composition, instruction addresses it. Our note on ESSA evidence tiers for keyboarding purchases has the language committees have used.
A recommendation that names its own evidence tier is harder to attack than one that hopes nobody asks.
What has to be true before a student logs in
Most of the fit review needs no purchase. The lesson sequence can be read on request, your student work samples are yours already, and an independent teacher can evaluate on their own account at no cost and with no student limit, which is enough to see how the sequence behaves with real children.
The moment a school class is on the platform, it is school use. School plans for Meta Typing Club have published yearly prices, districts receive a quote, and the data privacy agreement comes first, free or not. Ask us for the same four artifacts you demand of any vendor: a signed agreement, a named subprocessor list, a written retention and deletion period, and what a child account actually stores. Our public School Agreement states that student data is stored and processed in the United States, but our subprocessors are not documented publicly, so treat any compliance claim from us as unproven until it is in the contract. What is true and useful: accounts are created by a teacher or parent, no email is required for the child, and no age or date of birth is collected, so a fit review can run on neutral class identifiers with the roster mapping kept inside the school.
The honest sequence is read the lessons, run the artifacts, then ask for the quote, in that order.
Where this method fails
Artifact review rewards vendors who write good documentation. A committee reading a scope and sequence is reading marketing with a rubric attached, and a well-designed lesson map can sit on top of thin practice design. That objection is partly right, and I have watched adoption committees be charmed by a binder.
Two things blunt it. Pre-register the crosswalk rows and the decision rules before you see the product, so the rubric is not shaped by the sales deck. And let the technique tally break ties, because it is observed by your own staff in your own building and no vendor controls what it shows. If two products still pass on fit, price and privacy terms decide, which is a legitimate way for a district to choose.
Pre-registered rules and a technique tally beat a charming binder every time a committee is tempted to shortcut the crosswalk.
Key takeaways for the review file
- A 6-week window establishes fit; it cannot establish causal impact, because 5 hours of practice improves beginners on any platform.
- Your instructional materials criteria translate directly: alignment, program organization, assessment, universal access, and teacher support become 5 typing questions with 5 named artifacts.
- The crosswalk takes about 2 hours per grade band and is the deliverable the committee actually votes on.
- Published grade targets to crosswalk against include 5 WPM times grade level and Arlington ISD's ladder of 15 WPM at grade 3 and 25 at grade 5.
- Collect 3 artifacts only: a dated lesson map, week 1 and week 6 writing samples, and a 10-minute technique tally.
- Meta Typing Club has more than 2,400 lessons, reports words per minute only, and offers no rostering import, so account creation is manual.
- Write keep, scale and drop rules before week 1, including the 80 percent coverage threshold.
- A keyboarding purchase is an ESSA Tier 4 rationale at best; name that in the recommendation rather than waiting to be asked.
- School plans have published yearly prices; an independent teacher's own account is free with no student limit, and that evaluation is not a pilot.
Meta Typing Club will send the full lesson sequence to any district building this file, before a single account is created.
Questions a director of teaching and learning asks first
How long does an instructional-fit review take?
Two hours per grade band to build the crosswalk, six weeks of light collection in the classroom, and about ninety minutes of committee time to read it. The reading is short because the artifacts are few. Most of the calendar cost sits with the pilot teacher, which is why the collection list stays at three items.
Can we do any of this without buying anything?
Most of it. Reading the lesson sequence, mapping it to your benchmarks and pulling your own student writing samples all happen before a purchase. Classroom use with a school class is different: that is school use, which needs a signed data privacy agreement first and then a school account, starting with a 30-day trial with no payment card.
What do we ask the vendor for before week 1?
The full lesson sequence with lesson counts per skill, a sample class report with fake data, the help documentation a teacher would use, the four privacy artifacts, and a written per-student quote with the renewal date on it. If a vendor cannot produce the sequence, you have learned something worth knowing.
Which grade should we pilot in?
Grade 3 if your state tests are typed there, because that is where the consequence lands, and a second section in grade 4, where W.4.6 asks for a full typed page in a single sitting. Piloting in grade 5 flatters everyone: the students already type well enough that the platform looks better than it is.
What if teachers like it but the data is flat?
Teacher enthusiasm is a real finding about implementation and a weak finding about learning. Flat speed data over six weeks is expected. Read the technique tally and the writing samples instead, and if those are flat too, the honest recommendation is to keep the instructional minutes and change the product.
Does a pilot like this count as evidence in our adoption file?
It counts as local implementation evidence, which is what a curriculum review committee is entitled to weigh. It is not an efficacy study and should never be labeled one. Under ESSA it supports a Tier 4 rationale, and pairing it with your typed assessment calendar is what makes that rationale defensible.
How does this work for our multilingual students?
Ask which scripts the platform actually teaches rather than which interface languages it displays. Meta Typing Club runs structured lessons in multiple international languages, including right-to-left scripts such as Persian, Pashto and Dari, which matters for newcomer students who type in two scripts. Add a newcomer to your three named student cases.
The right question is always which script the platform teaches, not which languages its interface displays.
What to put on the committee agenda
Bring three documents to the April meeting: the crosswalk with your grade-band rows, the three artifacts from the pilot section, and the decision rules you wrote in advance. Keep the speed chart in the appendix where it belongs. If you want to see what a sequence looks like before you commit a teacher's time, our structured keyboarding lessons are readable end to end, the six-week pilot design a principal can approve covers the mechanics this post deliberately skips, and a K-2 walkthrough guide shows what technique looks like earlier in the grades. Ask us for the sequence and the quote in writing, and hold every vendor to the same file.
The committee that reviews a typing pilot with a crosswalk, three artifacts and a written decision rule will not be the committee charmed by a chart.


