Close Window

OKAPI! On-Line Manual
*Last Updated 15 Dec 01

Select a Section of This Manual To Visit


Section I: Key Points About OKAPI!
Introduction. OKAPI! is a web-based application that allows you to enter a text sample and to format that sample as a set of Examiner and Student Curriculum-Based Assessment (CBA) reading probes. The application also computes a readability index for the sample. OKAPI! can save you hours of work in creating correctly formatted CBA reading probes that include estimates of reading level.

OKAPI! gives you a range of options. You can for example change the font-type and letter-size for the CBA probes. Additionally, you can specify that either the Spache or Dale-Chall Readability Formula be used to compute a passage's readability index.
 

Basic Setting Options. OKAPI! has a number of features that you can set to change the appearance or content of the CBA probes or readability analyses:

Title. Type a
Figure 1: Title & Author Text Boxes
title for the CBA Probes or readability analysis into the Title text box (Figure 1). NOTE: This step is optional.

Author. Designate an author for the text sample in the CBA Probes or readability analysis by typing the author's name into the Author text box (Figure 1). NOTE: This step is optional.

Font Type. Use the Font drop-down list (Figure 2) to select the font-type. You can select one of three font-types for your CBA probes: Serif, Sans Serif, and Courier. (NOTE: Fonts determine the style and appearance of the letters that make up the text). Serif resembles well-known fonts such as Times New Roman or Palatino.
Figure 2: Options for Font Type & Text Size
Sans Serif resembles such fonts as Arial or Helvetica. Courier is a font that resembles the letter-forms produced by old-fashioned typewriters.

Text Size. Use the Text Size drop-down list (Figure 2) to select letter-size for the CBA probe. The application gives you several choices when setting the size of the text. As a general rule, more advanced student readers are able to handle text of smaller size while younger or less-skilled readers read better when given text of larger size.

Readability Formula. The Readability Formula
Figure 3: Options for Readability Formula

drop-down list (Figure 3) allows you to choose from two widely-used formulas to calculate the reading difficulty of a text sample. The Spache Readability Formula is typically used to calculate the difficulty of text that falls at the third grade level or below. The Dale-Chall Readability Formula is most often used to calculate the difficulty of more advanced text (i.e., fourth grade and up). See the section below, About Readability Formulas, for a more detailed discussion of readability calculations.

Text to Be Analyzed. Type or paste your text sample into the Text to Be Analyzed box (Figure 4). Although you can place text of any word-length into the Text to Be Analyzed box, OKAPI! will format and return samples of no more than 180 words. (If you submit samples longer than this, the application automatically trims their length before processing and returning them.)
Figure 4: Text to Be Analyzed Box

Take care that your text samples do not contain misspellings and use correct end-of-sentence punctuation.

Keep in mind, too, that OKAPI! is generally quite forgiving of strange text formatting. You can, for example, copy text directly from a web page and paste it into the Text to Be Analyzed box. Even though the text will probably seem erratically formatted in the text box, OKAPI! will automatically correct the formatting before displaying the finished CBA Probes or Readability Analysis.

'Magic' Characters. OKAPI! has several reserved ("magic") characters that you can use to fine-tune the final appearance your CBA Probes or to increase the accuracy of the selected reading formula. These are described below:

  • Asterisk ("*"): Tag Words to Be Ignored in Readability Analysis: Put an asterisk just in front of any word that you want to be counted automatically as an 'easy word' in the Spache or Dale-Chall Readability Formula. (Do not leave a space between the asterisk and the target word.) You need to tag a word only once and OKAPI! will 'remember' that 'easy word' no matter how many additional times it should appear in the passage.

    For example, you would tag the name Eddie as *Eddie to signal to OKAPI! that this word is to be automatically counted as an 'easy word'. (Note: For the Spache Formula, you should mark any person's first name with an asterisk to exempt it from analysis. For the Dale-Chall Formula, you should mark with an asterisk any names of individual people (to include all first, middle, or last names that appear), as well as the names of places. )

  • Backslash ("\"): Force Additional Sentence Breaks: Place this character just before any point in the text where you want to force OKAPI! to break up a longer sentence and count it as 2 shorter sentences. (Do not leave a space between the symbol and the target text.) OKAPI! will interpret this symbol as an additional sentence break, helping to reduce the average number of words per sentence in the final readability calculation.
  • Right Bracket (">"): Force Paragraph Breaks: By default, OKAPI! formats all passages as single paragraphs, regardless of the formatting of the text that you originally typed or pasted in to the Text to Be Analyzed box. If you want to break your text sample into multiple paragraphs, place a right-bracket (">") just in front of any text that you want to appear indented on a new line. (Do not leave a space between the symbol and the target text.) You can insert as many forced-paragraph breaks into the text as you like.
  • Underscore ("_"): Ignore End-Of-Sentence Punctuation in a Word: Sometimes your text sample may contain a word that includes periods (e.g., Y.W.C.A.). Or your text sample may include a quoted clause (with its own end punctuation) that is embedded within a larger sentence (e.g., "I am running out of time!", he said.). OKAPI! permits you to place an underscore before any word to indicate that the program should ignore any end-of-sentence punctuation that might appear in that word. (Do not leave a space between the symbol and the target word.) If you wished to tag the word time in the example above so that OKAPI! ignores the exclamation point that appears with it, you would place an underscore character directly in front of the targe word: e.g., "I am running out of _time!", he said.
 

Additional Setting Options. You can select additional options that can help you to better understand the readability formula used or to edit the text sample that you plan to use to create a CBA probe:

Highlight Difficult Words. Check the
Figure 5: Additional Setting Options
Highlight Difficult Words checkbox (Figure 5) if you wish to know which words from the text sample were not found on the Spache or Dale-Chall 'easy word list' . If this box is checked, 'difficult' words will be highlighted on the Examiner copy of the CBA Probe or Readability Analysis page. (See the section below, About Readability Formulas, for a more detailed discussion of how readability calculations are computed.) NOTE: By default, this option is checked.

Show Readability Formula. Check the Show Readability Formula checkbox
Figure 6: Show Sentence Boundaries Example

(Figure 5) if you want to view the formula (Dale-Chall or Spache) used to calculate the readability index for the text sample. If checked, this formula will appear on the Examiner Copy of the CBA Probe or on the Readability Analysis page. (See the section below, About Readability Formulas, for a more detailed discussion of how readability calculations are computed.) NOTE: By default, this option is checked.

Show Sentence Boundaries. If checked, the Show Sentence Boundaries checkbox (Figure 5) will format the sentences of the text sample so that alternating sentences appear in red and blue respectively. (See Figure 6 for an illustration of this feature.) This special color formatting will appear on the Examiner Copy of the CBA Probe
Figure 7: Submit Button Options

or on the Readability Analysis page--but will not appear on the Student Copy of the CBA Probe. Show Sentence Boundaries is a convenience feature that allows you quickly to find any very long sentences that may appear in the sample. By locating and breaking up these longer sentences into shorter sentences, you can lower the readability index (level of reading difficulty) of the sample. (See the section below, About Readability Formulas, for a more detailed discussion of how readability calculations are computed.) NOTE: By default, this option is left unchecked.

Count Semi-Colons, Colons As Sentence Punctuation. When tallying the number of sentences that appear in a passage, some computer readability formula programs (e.g., Micropower & Light Readability Calculations) count sentence clauses or phrases that end with a colon or semi-colon as separate sentences. When you check the Count Semi-Colons, Colons As Sentence Punctuation box (Figure 5), OKAPI! includes colons and semi-colons as end-of-sentence punctuation. When the box is left unchecked, OKAPI! counts only the period, question-mark, and exclamation point as end-of-sentence punctuation. You may want to take advantage of the Count Semi-Colons, Colons As Sentence Punctuation option if your text sample uses compound sentences with multiple independent clauses divided by semi-colons or colons. These compound sentences can inflate the readability index for the passage, as both the Spache and Dale-Chall formulas factor the average number of words per sentence into their calculations. Selecting this option can help significantly to reduce the average number of words per sentence in the final readability calculation. NOTE: By default, this option is checked.
 

Creating CBA and Readability Analysis Pages. After you have entered a text sample into
Figure 8: Sample CBA Reading Probe: Examiner Copy

OKAPI!, you have several 'submit button' choices from which to select:

Create CBA Reading Probes. Click the Create CBA Reading Probes button (Figure 7) to make Examiner and Student copies of CBA Reading Probes. Each copy appears in its own browser window for you to print off and use. (NOTE: Please be patient when creating CBA probes with OKAPI! It may take from 15 to 90 seconds for the application to format and display the finished probes.) A sample Examiner Copy of a CBA Reading Probe appears in Figure 8. The Student CBA Probe is identical in formatting to the Examiner Probe, except that it lacks a running word total column and does not display readability statistics.

Run Readability Analysis.
The Run Readability Analysis button (Figure 7) will return a single page that displays the submitted text sample and readability statistics for that sample. The Readability Analysis Page is identical in formatting to the Examiner Probe (Figure 8) except that it lacks a running word total column.

Erase Contents of Form.
The Erase Contents of Form button (Figure 7) will erase all information entered into OKAPI!. It is a convenience feature. But be careful: Once you have erased the contents of the form, the step cannot be undone!
 

Section II: About Readability Formulas
Selecting the Appropriate Readability Formula. OKAPI! allows you to analyze your passage with either the Spache or Dale-Chall Readability Formula. The two formulas complement one another. The Spache was designed for assessing the readability of primary texts (Spache, 1953), through the end of third grade. The Dale-Chall is most accurate when used to gauge the readability of more advanced texts--i.e., fourth grade and above (Dale & Chall, 1948). If you believe that the passage that you are assessing is equivalent to a third grade text or below, use the Spache. If a text seems more advanced than third grade, use the Dale-Chall. If you are uncertain of the level of difficulty of your passage, first select the Spache formula. If the Spache readability results are higher than third grade, run the same passage again with the Dale-Chall.
 

Spache Readability Formula. The Spache Formula assesses
Figure 9: Spache Readability Formula

Spache Readability Index = (0.141 * Average Sentence Length) + (0.086 * Percent of Words in Passage Not Found on Spache Revised Word List) + 0.839 = Grade Equivalent Readability Score

the difficulty of a passage by first computing two different values from the text. The first measure is the average number of words per sentence, which is calculated by dividing the total number of words in the passage by the total number of sentences in the passage. The second measure used by the Spache is the percent of words in the passage not found on the Spache Revised Word List [web page]. OKAPI! plugs these values into a formula that includes three constants (Figure 9) to compute the Spache Readability Index (in Grade Equivalent format) for the sample passage. For more complete guidelines on using the Spache formula, review the Spache Readability Computation Sheet (web page; pdf document).
 

Dale-Chall Readability Formula.
Figures 10 & 11: Dale-Chall Readability Formula: Raw Score
& Conversion Chart

Dale-Chall Readability Index = (0.0496 * Average Sentence Length) + (0.1579 * Percent of Words in Passage Not Found on DaleWord List) + 3.6365 = Raw Score

Like the Spache, the Dale-Chall Formula assesses the difficulty of a passage by first computing two different values from the text. The first measure is the average number of words per sentence, which is calculated by dividing the total number of words in the passage by the total number of sentences in the passage. The second measure used by the Dale-Chall is the percent of words in the passage not found on the Dale Word List [web page]. OKAPI! plugs these values into a formula that includes three constants (Figure 10) to compute a raw score. Then OKAPI! consults a Raw Score to Grade Equivalent Conversion Chart to come up with a Grade Equivalent reading score (Figure 11). For more complete guidelines on using the Dale-Chall formula, review the Dale-Chall Readability Computation Sheet (web page; pdf document).
 

Tips to Improve the Accuracy of Readability Calculations. OKAPI! can remove a great deal of drudgery from the task of computing a readability index. The application is highly accurate in computing average sentence length and percent of 'difficult' words not found on a standard wod list--values that play a part in both the Spache and Dale-Chall formulas.

A passage's 'true' readability estimate is not likely to be higher than that returned by OKAPI! However, OKAPI! may sometimes slightly overestimate a passage's level of reading difficulty. This overestimation occurs because OKAPI! 's internal dictionary is not extensive enough to contain the names of all people or places that might qualify as 'easy' words under the Spache or Dale-Chall formulas. (The OKAPI! dictionary does include a list of the 200 most common male and female first names, though, based on data collected during the 1990 U.S. Census.) Use the guidelines below to 'fine-tune' readability results for your passage.

  • Spache. According to Spache guidelines (Spache, 1953), all first names are considered familiar words--but OKAPI! does not have the capability to identify all first names. Therefore, when using the Spache formula, you should place an asterisk (*) in front of any person's first name that appears in the text. (Do not leave a space between the asterisk and the target word.) The asterisk tells OKAPI! that the word should be treated as 'familiar'.

  • Dale-Chall. According to Dale-Chall guidelines (Dale & Chall, 1948), all names of people and places are considered familiar words--but OKAPI! does not have the capability to identify all names or places. Therefore, when using the Dale-Chall formula, you should place an asterisk (*) in front of the name of any person or place that appears in the text. (Do not leave a space between the asterisk and the target word.) The asterisk tells OKAPI! that the word should be treated as 'familiar'.
 

Section III: Tips for Advanced Users

Estimating the Readability Level of a Text. You can use OKAPI! to estimate the average reading level of larger sections of text, including chapters and even entire books (Dale & Chall, 1948). Follow these steps:

  1. Select at least 3-5 text samples from the document to analyze. Be sure to take these samples from different sections of the document (e.g., near the beginning, in the middle, near the end). Each sample should be 100-150 words in length.
  2. Using OKAPI!, run Spache or Dale-Chall readability statistics for each of the sample passages.
  3. Once you have collected readability values for all of the text samples, add those values together and divide by the number of samples analyzed to get an estimate of the mean or average readability level for the larger document. (NOTE: With the Dale-Chall, use raw scores when computing the mean. Then find the grade equivalent for that mean raw score value by consulting the Raw Scores to Grade Conversion Table.)
 

Using Public-Domain Texts As Source Material for CBA Probes. There are a number of web sites on the Internet that contain

Table 1: Some Recommended
Public-Domain Text Collections:

collections of stories, fables, legends, and other literature of high quality whose copyright protection has expired. Because these texts are now in the public domain, there are no restrictions on how you might use them. Using OKAPI!, you can quickly and conveniently turn sections of these public-domain texts into CBA reading probes. Here's how:

  1. Open a web browser window and go to the OKAPI! web site.
  2. Open a second browser window.
  3. While in that second browser window, go to one of the public-domain text collections listed in Table 1.
  4. Browse that site to find a text that you would like to convert into a set of CBA reading probes. Using your cursor, highlight about 100 to 150 words from that passage and copy it to your computer's clipboard (memory).
  5. Return to the web browser window displaying the OKAPI! page. Paste the selected public-domain text from the clipboard into the Text to Be Analyzed box. Add title and author information for the passage (optional). Click the appropriate button to create CBA probes. Print off these CBA probes for later use.
  6. Repeat steps 3-5 to create as many CBA probes as you need.
 

Section IV: Troubleshooting Problems

When I compare readability analyses run with the Spache and Dale-Chall methods on the same text sample, the results are significantly discrepant from each other. Why? The Spache and Dale-Chal readability formulas differ in significant ways, which explains why each returns different results when used to analyze a text sample. Here are just two noteworthy differences between the Spache and Dale-Chall: (1) While both formulas use a word list to determine whether a specific word in a text sample is easy or difficult, the Spache formula's wordlist contains fewer than 1000 words--while the Dale-Chall formula employs a list of 3000 words. As a result, the Spache will identify many more words in a sample as 'difficult' than will the Dale-Chall. (2) The Spache formula requires that a word be counted as 'difficult' only once, no matter how often it appears in the text sample. In contrast, the Dale-Chall counts a word as 'difficult' each time that it appears in a text sample. Differences in the size of the wordlists used and in the convention followed for counting up the total number of difficult words go a long way to explain why the two formulas return discrepant results when used on a single text sample.

Although these formulas can appear to return conflicting results, in fact the Spache and Dale-Chall were designed to complement each other (Spache, 1953). The Spache was constructed to be a reasonably accurate indicator of reading difficulty for texts up through the end of third grade. The Dale-Chall was explicitly designed to estimate readability for texts
beyond the third grade level. (Read through About Readability Formulas for a more complete discussion of how each of the readability formulas works and for formula-selection guidelines.)

OKAPI! takes a long time to display CBA pages or readability analyses. OKAPI! requires a lot of computer processing power to format text samples into CBA probes and to run readability analyses. It is not unusual for OKAPI! to take up to 90 seconds from the the time that you click the Create CBA Probes button to have those finished probes downloaded and displayed. When Internet traffic to the OKAPI! web site is heavy, you may find that it takes even longer for the program to process text samples. One solution is to visit OKAPI! during times when traffic is less heavy (e.g., early mornings or late evenings).

OKAPI! overlooks common names of people or places when computing readability levels. Because it contains an internal dictionary of only limited length, OKAPI! cannot identify most common names and places, even though such words should be counted as 'easy' under the Spache or Dale-Chall guidelines. (The OKAPI! dictionary does include a list of the 200 most common male and female first names, though, based on data collected during the 1990 U.S. Census.) You can 'fine-tune' readabiilty results by hand, though. Consult Magic Characters and Tips to Improve the Accuracy of Readability Calculations to find out how you can improve the accuracy of readability scores.

When I try to submit a text sample, OKAPI! returns an 'error' message. OKAPI! is a flexible program and usually is able successfully to read and analyze most text that you submit. However, once in a great while, a user will submit a text sample with 'strange' individual characters or combinations of characters that OKAPI! cannot understand. When the application cannot figure out how to analyze a non-standard text sample, it will respond with an error message. If this happens to you:

  1. take a close look at the text sample that you are trying to submit;
  2. edit or delete any non-standard text characters or combinations of text characters that you believe might be causing the error(s), and
  3. resubmit the text sample to OKAPI!.

I am having other problems in using OKAPI! If you are having significant problems of any kind with OKAPI!, please email me, Jim Wright, at jwright@lefthandlogic.com to share details about the problem. I will get back to you as soon as I can with an update about possible fixes or workarounds to the problem!

 

References
Dale, E., & Chall, J.S. (1948). A formula for predicting readability. Educational Research Bulletin, 27, 37-53.
Spache, G. (1953). A new readability formula for primary-grade reading materials.
The Elementary School Journal, 55, 410-413.

*A special thanks to John Rhine of Scott Foresman. In a personal communication (23 Oct 03), John drew attention to two corrections to be made in OKAPI. First, he pointed out that the Spache readability formula should be altered to count all 'numerical figures' (that is, numbers appearing in digit form) as 'known' words. Second, he noted that the Spache readability formula is recommended for use through the end of
third grade and the Dale-Chall for use in fourth-grade text and above. (The OKAPI manual had inaccurately set the upper limit of the Spache at the fourth grade and the Dale-Chall at fifth-grade and above.) Those corrections have since been made to OKAPI.
 

Close Window