Skip to main content
Meta Typing Club
Education

Pilot Design Choices That Decide the Scale-Up Vote

Meta Typing Club13 min read
Pilot Design Choices That Decide the Scale-Up Vote

A district pilot gets judged twice: on what it found, and on how it was built. Three decisions made before the first student logs in, which schools run it, which numbers you commit to in advance, and when your board hears from you, decide whether the scale-up recommendation survives its first hostile question in open session.

TL;DR: Run the pilot in a median school and a constrained school, never your strongest one. Commit the success thresholds to the charter your board adopts, before any data exists. Report on a fixed cadence, with a delivery-only update at the midpoint. Bring a written per-student quote to the scale-up vote, because a district rollout is a quoted purchase.

Scale-up is where pilots die, and your board is not being unfair

Your trustees have watched software arrive and vanish before. LearnPlatform's 2026 EdTech Top 40 puts district access at an average of 3,001 unique digital tools, while students and educators each interact with about four of them. The Penn Center for Learning Analytics, reviewing 48 districts, found a median 70 percent of student software licenses completely unused, and 97.6 percent not used to the level intended.

As of 2026, a trustee who greets a promising pilot with suspicion is reading the base rate correctly.

What follows is the defensibility layer, not the mechanics. Week-by-week operations belong in the six-week pilot design a principal can approve, and the evidence bar itself in what a typing pilot must prove before your board scales it. This is the part that decides whether anyone believes your result.

A pilot that cannot survive one skeptical question in open session was designed wrong, whatever the data says.

Do not run it at your best school

The site is the first thing a trustee will name. Choose the building with the newest devices, the deepest bench of veteran staff and the most involved parents, and you have pre-loaded the objection before anyone types a word: of course it worked there.

Pair two sites instead. One median school, chosen on your own demographic and device data, and one constrained school: the highest share of students in poverty, the largest English learner enrollment, or the oldest cart in the district. English learners were 10.6 percent of US public school students in fall 2021, ranging from 0.8 percent in West Virginia to 20.2 percent in Texas, so a trustee whose zone sits well above your district average will ask whether the pilot included students like theirs.

Home practice deserves the same caution. NCES reported that in 2021, 97 percent of 3 to 18 year olds had home internet access, but in the lowest income quartile only 85 percent reached it through a computer rather than a phone alone. A design that leans on practice at home measures device access as much as it measures instruction.

Pilot site choiceWhat the board hears at scale-upWhat it costs you
Your strongest schoolOf course it worked thereThe result cannot be generalized to 30 other buildings
Median school on your own dataThis is what most of our schools look likeSlower start, more coaching hours
Constrained school: poverty, English learners, oldest devicesIt worked where we worry mostHigher risk of a null result caused by conditions
Volunteer teachers only, at any siteYou measured enthusiasmImplementation looks better than a rollout will

Declare before the first session that the constrained site's result, not the average of the two, is the basis for your scale-up recommendation.

Write the success statement while you can still be wrong

Pre-registration is borrowed from program evaluation: you state what would count as success before you can see which way the data leans. Digital Promise's edtech pilot planning guidance puts a written success statement with specific benchmarks ahead of implementation, drafted with educators, leaders and families. In a district the purpose is narrower and more political. A threshold written in October cannot be moved in April.

Thresholds need a source, and the honest answer here is uncomfortable: no validated national typing benchmark exists. What exists is a practitioner convention, five words per minute times grade level at 80 to 95 percent accuracy, published independently by Wisconsin's Department of Public Instruction, Arlington ISD and Boston Public Schools. Use it, and call it a convention in the charter so that nobody reports it upward as a cut score.

Pre-registered metricThreshold committed in advanceMeasuredWhat a miss means
Grade 3 median typing speed15 WPM at 80 percent accuracy or betterWeek 1 and week 24Report it as found; do not re-cut the sample
Share of grade 3 students below 10 WPMFalls by halfWeek 24Instruction reached the middle and missed the tail
Minutes delivered against minutes plannedAt least 80 percentWeekly, by classThe finding is about the calendar, not the tool
Homework completion by studentAt least 70 percent of assignmentsMonthlyCheck home device access before motivation
Teacher time added per weekNo more than 20 minutes of setup and reviewTeacher log, week 6 and week 20The second year of rollout will not hold

Be equally plain about evidence. ESSA sets four tiers, and the fourth, demonstrates a rationale, is where most typing practice software sits. A two-school pilot across one school year does not manufacture Tier 2 evidence, and a charter implying that it will is a goalpost you hand your critics. Our walkthrough of ESSA evidence tiers for keyboarding purchases sets out what each tier actually requires of a district.

A metric you would be embarrassed to publish before the pilot starts is not a metric, it is a hope.

Half the report is whether the thing actually happened

Durlak and DuPre reviewed more than 500 studies and concluded that the level of implementation affects program outcomes, alongside a long list of factors that determine whether a program is delivered as designed. In district language: a program that was not delivered tells you nothing about the program.

So build the report around delivery first. Minutes actually taught per class per week against minutes planned. Homework completion by student rather than by class average. The count of weeks a block was surrendered to a testing window, an assembly or a substitute shortage. Then the outcome numbers, in that order.

Our own product sits in a narrow slot here. Meta Typing Club reports per-student completion, accuracy, words per minute and stars for homework assigned with optional due dates, which is the delivery evidence a pilot report needs. Two limits belong in the same breath: the dashboard reports words per minute only, so any characters-per-minute figure in your report is a conversion you performed yourself, and there is no roster integration, so a school uploads a CSV file or adds students one by one, or a teacher or parent creates each account.

A null result from a pilot that ran 40 percent of its planned minutes is a finding about your calendar, not about typing.

Put your board on a cadence so nothing arrives as a surprise

Three contacts, fixed in the charter. The board adopts the charter with the metric table attached. At the midpoint, an update that reports delivery only and makes no outcome claim, because a mid-pilot outcome number is the fastest way to lose control of the story. At the end, the final report in the pre-registered format, in the packet a week before the meeting rather than on the screen during it.

No study on board reporting cadence is worth citing to you, and I am not going to invent one. This part is practice, not evidence. What is checkable is the failure mode: a trustee reading a result for the first time in public session interrogates the design instead of the finding, and the design is the one thing you did not want to spend that meeting defending.

Keep the roles straight in the document as well. The board votes the budget and the policy, staff select the tool, purchasing runs the process. A charter that blurs those lines hands every objector a procedural reason to delay.

The best case against everything above

The strongest objection is not that this is wrong. It is that it is theater. Pre-registration comes out of clinical trials and lands in an organization that runs on professional judgment, and it can make a district look foolish when a threshold set in October turns out to have measured the wrong thing by April. Worse, deliberately siting a pilot where conditions are hardest risks a null result produced by a broken cart, a long-term substitute and a February flu wave, killing an initiative that would have worked in 30 buildings.

Part of that lands, and I would rather concede it than pretend. Two answers, both partial. Write an amendment clause into the charter so metrics may change by recorded vote, which keeps a change visible instead of silent. And if the budget funds one site rather than two, run the median school, not the strongest, then put the generalizability limit in your own report before a trustee finds it.

A two-school pilot can tell you whether your district is able to run this; it cannot tell you whether it works, and saying so first is what makes the rest of your report credible.

What to say when a trustee asks the price

The money question arrives in the first three minutes, and the honest answer has two steps that must not be blurred together.

The step that needs no budget line is an instructional audit your own staff can run in a week: who teaches keyboarding in this district, in which grades, for how many minutes, and who owns the outcome. One page. It needs no vendor, and it holds up in open session.

The second step is priced. Districts and school networks receive a quote for Meta Typing Club, so a written per-student number belongs in the packet before the vote. For scale, Typing.com states school pricing starting as low as $1.14 per student, and edclub publishes seat bands for TypingClub's School Edition, so a board can bracket the order of magnitude before anyone books a sales call. Two no-cost routes exist: each new school gets a 30-day trial with no payment card, and an independent teacher, on their own account, can evaluate at no cost with no student limit. That is an evaluation, not a pilot, and once a school's students are on the platform it is school use, which belongs behind your data privacy agreement like every other vendor.

Budget the paperwork too, as your own line item. The Student Data Privacy Consortium does not bill you for that review; it sizes the savings from more than 222,000 standard agreements executed since 2016 by valuing the negotiation each one avoids at one hour of legal time, at an average legal fee of $250 an hour. Use that as the reference point and budget your own counsel's hours per vendor agreement. Our breakdown of the real total cost of a district typing program prices the other lines.

A trustee cannot move a motion against a blank fiscal note, so get the quote in writing before the item reaches the agenda.

Key takeaways

  • Pair two pilot sites, one median and one constrained, and name the constrained site's result as the basis for the scale-up recommendation.
  • Commit thresholds in advance; five words per minute times grade level at 80 to 95 percent accuracy is a practitioner convention, not a validated cut score.
  • Track minutes delivered against minutes planned, because below 80 percent your pilot reports on the calendar rather than on typing instruction.
  • Most typing practice software sits at ESSA Tier 4, and a single-year pilot in two schools does not lift it to Tier 2.
  • Districts hold access to an average of 3,001 digital tools and leave a median 70 percent of licenses unused, which is why a board starts skeptical.
  • Three board contacts, charter adoption, a delivery-only midpoint and a final report distributed a week ahead, keep results from arriving as a surprise.
  • The zero-budget first step is a one-page instructional audit; a district rollout of Meta Typing Club is quoted.
  • An independent teacher can evaluate on their own account with no student limit, and school use goes through the district's data privacy agreement first, whatever it costs.

Questions a superintendent asks before signing the charter

How many schools should a keyboarding pilot include?

Two is the practical minimum for a defensible recommendation: one median school and one constrained school. A single site gives a trustee an easy dismissal. More than three multiplies coordination cost without strengthening the argument, because the pilot still cannot establish efficacy at any size your district can fund.

How long does a typing pilot need to run?

Plan a full semester at minimum, and a school year if the calendar allows. Structured practice produces roughly 10 words per minute of gain per month across Meta Typing Club's 10,000-plus learners as a whole, but elementary students starting from near zero move more slowly, and a six-week window mostly measures novelty.

What do I say to the board if the pilot fails?

Say it plainly, using the thresholds the board adopted, and separate delivery from outcome. A pilot that hit 55 percent of planned minutes failed to run, which is a different finding than a pilot that ran fully and moved nothing. Pre-registration is what makes that distinction credible rather than defensive.

What does school access cost?

A single school sees published yearly prices, USD 250 for School Plus and USD 500 for School Pro, and districts receive a quote, so ask for a written per-student figure, the term length and the renewal terms in one email. Published market comparisons start as low as $1.14 per student. Then add your own counsel's hours: the Student Data Privacy Consortium's benchmark is about an hour per agreement at $250.

Does the board vote on the pilot itself?

That depends on your policy and your bid threshold. Many pilots sit under the threshold and need only administrative approval, but bringing the charter to the board anyway buys something valuable: the metrics are adopted in public, so they cannot be relitigated at scale-up.

What has to be signed before students log in?

Your district's data privacy agreement, on your state or consortium template, and any parent notification your state statute requires. Ask every vendor for a signed agreement, a named sub-processor list, a written retention and deletion period, and a field-level description of what a child account stores.

How do I keep this alive after I leave?

Average superintendent tenure sits at 5.4 years, so an initiative that depends on your attention will not outlast you. Put the minutes in the scope and sequence, the checkpoint in the assessment calendar, and the owner in a job description, as our piece on which district initiatives survive your successor sets out.

Your next board packet

The pilot you can defend at scale-up is designed in the charter, not rescued in the report. Pick a median site and a constrained site, publish the thresholds before the data exists, log delivery every week, and put the board on a three-contact cadence so the final meeting is a confirmation rather than a debate. Then bring the price: a written per-student quote, the privacy review hours, and the staff time. If Meta Typing Club is on your list, ask us for that quote and for a walkthrough of the structured lesson sequence your grade bands would actually use.

Design the pilot so that the least friendly person in the room can check every number in it.

#district pilot design#school board governance#superintendent decisions#edtech evaluation#keyboarding instruction#pilot metrics
Share:

You Might Also Like