AMERICAN EDUCATIONAL RESEARCH ASSOCIATION, INC. et al v. PUBLIC.RESOURCE.ORG, INC.

Filing 136

Second MOTION for Summary Judgment by PUBLIC.RESOURCE.ORG, INC. (Attachments: # 1 [REDACTED] Public Resources Memorandum of Law, # 2 Declaration Carl Malamud, # 3 Declaration Matthew Becker, # 4 [REDACTED] Public Resources Statement of Material Facts, # 5 [REDACTED] Public Resources Statement of Disputed Facts, # 6 [REDACTED] Public Resources Objections to Plaintiffs Evidence, # 7 Public Resources Request for Judicial Notice in Opposition, # 8 Text of Proposed Order, # 9 Certificate of Service)(Bridges, Andrew)

Download PDF
UNITED STATES DISTRICT COURT FOR THE DISTRICT OF COLUMBIA AMERICAN EDUCATIONAL RESEARCH ASSOCIATION, INC., AMERICAN PSYCHOLOGICAL ASSOCIATION, INC., and NATIONAL COUNCIL ON MEASUREMENT IN EDUCATION, INC., Plaintiffs, v. PUBLIC.RESOURCE.ORG, Case No. 1:14-CV-00857-TSC-DAR DEFENDANT-COUNTERCLAIMANT PUBLIC.RESOURCE.ORG, INC.’S OBJECTIONS TO PLAINTIFFS’ EVIDENCE IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND PERMANENT INJUNCTION Action Filed: May 23, 2014 Defendant. [PUBLIC REDACTED VERSION] TABLE OF CONTENTS Page STANDARDS FOR ADMISSIBLE EVIDENCE IN RULING ON A MOTION FOR SUMMARY JUDGMENT ..............................................................................................................1 A. Irrelevant Evidence ..................................................................................................1 B. Lack of Personal Knowledge/Foundation................................................................2 C. Improper Lay Testimony on Legal Conclusions or Expert Subject Matter .......................................................................................................................3 D. Hearsay ....................................................................................................................4 E. Unauthenticated Documents ....................................................................................5 F. Secondary Evidence Rule ........................................................................................5 OBJECTIONS TO DECLARATIONS FILED IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT.....................................................................................5 II. OBJECTIONS TO THE DECLARATION OF WAYNE J. CAMARA IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION ..........................................................5 III. OBJECTIONS TO THE DECLARATION OF MARIANNE ERNESTO IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION ........................................................18 IV. OBJECTIONS TO THE DECLARATION OF KURT F. GEISINGER IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION ........................................................38 V. OBJECTIONS TO THE DECLARATION OF PLAINTIFFS’ LEAD COUNSEL JONATHAN HUDIS IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION ....................................................................................................................53 VI. OBJECTIONS TO THE DECLARATION OF FELICE J. LEVINE IN SUPPORT OF PLAINTIFFS MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION ........................................................62 VII. OBJECTIONS TO THE DECLARATION OF DIANNE L. SCHNEIDER IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION ........................................................80 i TABLE OF CONTENTS (Continued) Page VIII. OBJECTIONS TO THE DECLARATION OF LAURESS L. WISE IN SUPPORT OF PLAINTIFFS MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION ........................................................83 CONCLUSION ..............................................................................................................................95 ii TABLE OF AUTHORITIES Page(s) CASES  Anheuser-Busch, Inc. v. Natural Beverage Distribs., 69 F.3d 337 (9th Cir. 1995) .......................................................................................................4 Barthelemy v. Air Lines Pilots Ass’n, 897 F.2d 999 (9th Cir. 1990) .....................................................................................................2 Blair Foods, Inc. v. Ranchers Cotton Oil, 610 F.2d 665 (9th Cir. 1980) .....................................................................................................4 Block v. City of Los Angeles, 253 F.3d 410 (9th Cir. 2001) .....................................................................................................1 Boyd v. City of Oakland, 458 F. Supp. 2d 1015 (N.D. Cal. 2006) .....................................................................................2 Cambridge Elecs. Corp. v. MGA Elecs., Inc., 227 F.R.D. 313 (C.D. Cal. 2004) ...............................................................................................4 Evangelista v. Inlandboatmen’s Union of Pac., 777 F.2d 1390 (9th Cir. 1985) ...................................................................................................3 Express, LLC v. Fetish Group, Inc., 464 F. Supp. 2d 965 (C.D. Cal. 2006) .......................................................................................2 Gable v. Nat’l Broad. Co., 727 F. Supp. 2d 815 (C.D. Cal. 2010), aff’d, 438 F. App’x 587 (9th Cir. 2011) ......................3 In re Cypress Semiconductor, Inc. Sec. Litig., 891 F. Supp. 1369 (N.D. Cal. 1995), aff’d, 113 F.3d 1240 (9th Cir. 1997) ..............................4 Int’l Church of Foursquare Gospel v. City of San Leandro, 902 F. Supp. 2d 1286 (N.D. Cal. 2012) .....................................................................................4 Kumho Tire Co. v. Carmichael, 526 U.S. 137 (1999) ...................................................................................................................3 Lujan v. Nat’l Wildlife Fed’n, 497 U.S. 871 (1990) ...................................................................................................................4 Orr v. Bank of America, 285 F.3d 764 (9th Cir. 2002) .............................................................................................1, 2, 4 iii TABLE OF AUTHORITIES (Continued) Page(s) Pierce v. Kaiser Found. Hospitals, CV 09-03837 WHA, 2010 WL 4590930 (N.D. Cal. Nov. 4, 2010), aff’d, 470 F. App’x 649 (9th Cir. 2012).....................................................................................3 Riggsbee v. Diversity Servs., Inc., 637 F.Supp.2d 39, 46 (D.D.C. 2009) .........................................................................................4 Smith v. Hughes Aircraft Co., 22 F.3d 1432 (9th Cir. 1993) .....................................................................................................2 Soremekun v. Thrifty Payless, Inc., 509 F.3d 978, 984 (9th Cir. 2007) .............................................................................................4 U.S. Aviation Underwriters, Inc. v. Yellow Freight Sys., Inc., 296 F. Supp. 2d 1322, 1331 (S.D. Ala. 2003)............................................................................3 U.S. ex rel. Miller v. Bill Harbert Intern. Const., Inc., 608 F.3d 871 (D.C. Cir. 2010) ...................................................................................................1 U.S. v. Davis, 596 F.3d 852 (D.C. Cir. 2010) ...................................................................................................2 Uche-Uwakwe v. Shinseki, 972 F. Supp. 2d 1159 (C.D. Cal. 2013) .....................................................................................2 United States v. 87.98 Acres of Land More or Less in the County of Merced, 530 F.3d 899 (9th Cir. 2008) .....................................................................................................3 United States v. Dibble, 429 F.2d 598 (9th Cir. 1970) .....................................................................................................5 United States v. Hampton, 718 F.3d 978 (D.C. Cir. 2013) ...................................................................................................3 RULES Fed. R. Civ. P. 26(a) ..........................................................................................................38, 80, 95 Fed.R.Civ.P. 30(b)(6)...............................................................................................................61, 80 Fed. R. Civ. P. 37 ...............................................................................................................38, 80, 95 Fed. R. Civ. P. 56 .........................................................................................................................2, 5 iv TABLE OF AUTHORITIES (Continued) Page(s) Fed. R. Civ. P. 56(c) ....................................................................................................................1, 2 Fed. R. Civ. P. 56(e) ........................................................................................................................4 Fed. R. Evid. 101 .............................................................................................................................1 Fed. R. Evid. 402 ................................................................................................................... passim Fed. R. Evid. 403 ................................................................................................................... passim Fed. R. Evid. 602 ................................................................................................................... passim Fed. R. Evid. 701 ................................................................................................................... passim Fed. R. Evid. 702 ................................................................................................................... passim Fed. R. Evid. 802 ...............................................................................................................18, 80, 95 Fed. R. Evid. 901 .............................................................................................................................5 Fed. R. Evid. 1001 ...........................................................................................................................5 Fed. R. Evid. 1002 ................................................................................................................. passim Fed. R. Evid. 1101 ...........................................................................................................................1 v Defendant-Counterclaimant Public.Resource.Org, Inc. hereby submits the following objections to the Declarations submitted in support of Plaintiffs’ Renewed Motion for Summary Judgment and for Permanent Injunction, ECF No. 134. Plaintiffs refiled numerous declarations and exhibits that had been filed in their earlier Motion for Summary Judgment [Dkt. 60]. For that reason, to avoid any risk of waiving its objections, Public Resource refiles its objections to evidence applicable to those submissions, below.1 ICE Exhibit citations refer to the exhibits listed in the Index of Consolidated Exhibits, Dkt. 70. STANDARDS FOR ADMISSIBLE EVIDENCE IN RULING ON A MOTION FOR SUMMARY JUDGMENT It is fundamental that trial courts “can only consider admissible evidence in ruling on a motion for summary judgment.” Orr v. Bank of America, 285 F.3d 764, 773 (9th Cir. 2002) (emphasis added); see also Fed. R. Civ. P. 56(c); Fed. R. Evid. 101 (Rules of Evidence apply to all proceedings in the courts of the United States); Fed. R. Evid. 1101 (listing exceptions to Rule 101). Hearsay, documents that cannot be authenticated, out-of-context excerpts, and evidence with no foundation will not suffice, and are not to be considered by the court in ruling on motions for summary judgment or adjudication. See Block v. City of Los Angeles, 253 F.3d 410, 418-19 (9th Cir. 2001) (deciding that consideration of a declaration’s facts not based on personal knowledge was an abuse of discretion because such facts were inadmissible). Much of the evidence on which Plaintiffs attempt to rely fails to meet the minimum threshold requirements of admissibility, as set forth below: A. Irrelevant Evidence Irrelevant evidence cannot be considered in summary judgment proceedings. See Fed. R. Evid. 402; see also U.S. ex rel. Miller v. Bill Harbert Intern. Const., Inc., 608 F.3d 871, 897 1 These objections originally appeared at Dkt. 69-4. Public Resource has excised any objections that concern documents that Plaintiffs did not refile. 1 (D.C. Cir. 2010) (“To be admitted, evidence must be relevant.”); Smith v. Hughes Aircraft Co., 22 F.3d 1432, 1439 (9th Cir. 1993) (affirming trial court’s refusal to consider irrelevant evidence on summary judgment); Uche-Uwakwe v. Shinseki, 972 F. Supp. 2d 1159, 1165 (C.D. Cal. 2013) (sustaining objection that statement filed in support of motion for summary judgment was inadmissible for lack of relevance and foundation). B. Lack of Personal Knowledge/Foundation A fact witness may not testify to a matter unless the witness has personal knowledge of the matter. Fed. R. Evid. 602; Fed. R. Civ. P. 56(c) (“declaration used to support or oppose a motion must be made on personal knowledge, set out facts that would be admissible in evidence, and show that the affiant or declarant is competent to testify on the matters stated”); U.S. v. Davis, 596 F.3d 852, 856 (D.C. Cir. 2010) (“The Rules also prohibit a witness from testifying unless he has personal knowledge of the subject of his testimony.”); Orr, 285 F.3d at 774 & n.9; Express, LLC v. Fetish Group, Inc., 464 F. Supp. 2d 965, 973 (C.D. Cal. 2006) (“Declarations submitted in conjunction with summary judgment proceedings must . . . be based on personal knowledge”). Further, “[a] declarant’s mere assertions that he or she possesses personal knowledge and competency to testify are not sufficient.” Boyd v. City of Oakland, 458 F. Supp. 2d 1015, 1023 (N.D. Cal. 2006). A declarant must show personal knowledge and competency “affirmatively,” under Rule 56, for example, by “the nature of the declarant’s position and nature of participation in matter.” Id.; see also Barthelemy v. Air Lines Pilots Ass’n, 897 F.2d 999, 1018 (9th Cir. 1990) (inferring personal knowledge from affiants’ “positions and the nature of their participation in the matters to which they swore”). The fact that Public Resource does not object to the witnesses’ testimony that they have personal knowledge of the facts stated in their declarations and are competent to testify thereto does not in any way signal Public Resource’s agreement with those assertions. Public Resource merely does not contend those statements are 2 inadmissible—but they may be wrong. C. Improper Lay Testimony on Legal Conclusions or Expert Subject Matter Legal conclusions are not admissible evidence. See Pierce v. Kaiser Found. Hospitals, CV 09-03837 WHA, 2010 WL 4590930, at *8 (N.D. Cal. Nov. 4, 2010), aff’d, 470 F. App’x 649 (9th Cir. 2012) (excluding numerous declarant statements containing inadmissible legal conclusions). The Declarants, without any legal expertise, repeatedly purport to state legal conclusions and the legal effects of documents supposedly relevant to this dispute. See Fed. R. Evid. 701; see also Evangelista v. Inlandboatmen’s Union of Pac., 777 F.2d 1390, 1398 n.3 (9th Cir. 1985) (lay opinion construing contract provisions is inadmissible); Pierce, 2010 WL 4590930, at *8 (declaration that opponent “breached” agreement or “violated” laws is inadmissible legal conclusion). Testimony requiring scientific, technical, or other specialized knowledge may be given only by an expert witness with the requisite knowledge, skill, experience, training, or education, and opinion testimony is not permitted of a lay person. Fed. R. Evid. 701, 702; see also United States v. Hampton, 718 F.3d 978, 981–82 (D.C. Cir. 2013) (finding error when district court allowed FBI agent to testify as a lay witness in the form of an opinion without an applicable exception in Rule 701); U.S. Aviation Underwriters, Inc. v. Yellow Freight Sys., Inc., 296 F. Supp. 2d 1322, 1331 (S.D. Ala. 2003) (unqualified expert opinions inadmissible at summary judgment). The “proponent of the expert bears the burden of demonstrating that the expert is qualified.” Gable v. Nat’l Broad. Co., 727 F. Supp. 2d 815, 833 (C.D. Cal. 2010), aff’d, 438 F. App’x 587 (9th Cir. 2011) (citing United States v. 87.98 Acres of Land More or Less in the County of Merced, 530 F.3d 899, 904-05 (9th Cir. 2008)). See also Kumho Tire Co. v. Carmichael, 526 U.S. 137, 147-48 (1999) (expert must have specialized knowledge). 3 One type of improper lay opinion is unsupported, speculative, and conclusory statements. These statements, as well as and claims of opposing parties and their attorneys, are not evidence and do not raise a genuine issue of material fact sufficient to preclude summary judgment. Lujan v. Nat’l Wildlife Fed’n, 497 U.S. 871, 888 (1990) (The purpose of Rule 56(e) is “not to replace conclusory allegations of the complaint with conclusory allegations of an affidavit.”). Rather, “[w]here the moving party will have the burden of proof at trial, it must affirmatively demonstrate that no reasonable trier of fact could find other than for the moving party.” Int’l Church of Foursquare Gospel v. City of San Leandro, 902 F. Supp. 2d 1286, 1290-91 (N.D. Cal. 2012) (citing Soremekun v. Thrifty Payless, Inc., 509 F.3d 978, 984 (9th Cir. 2007)). Cf. Orr, 285 F.3d at 783 (“To defeat summary judgment, [one opposing summary judgment] must respond with more than mere hearsay and legal conclusions”); Cambridge Elecs. Corp. v. MGA Elecs., Inc., 227 F.R.D. 313, 320 (C.D. Cal. 2004) (“Conclusory, speculative testimony in affidavits and moving papers is insufficient to raise genuine issues of fact and defeat summary judgment”). D. Hearsay Generally, “inadmissible hearsay evidence may not be considered on a motion for summary judgment.” Anheuser-Busch, Inc. v. Natural Beverage Distribs., 69 F.3d 337, 345 n.4 (9th Cir. 1995); see also Blair Foods, Inc. v. Ranchers Cotton Oil, 610 F.2d 665, 667 (9th Cir. 1980) (“hearsay evidence is inadmissible and may not be considered by this court on review of a summary judgment”); Riggsbee v. Diversity Servs., Inc., 637 F.Supp.2d 39, 46 (D.D.C. 2009) (“on summary judgment, statements that are impermissible hearsay or that are not based on personal knowledge are precluded from consideration by the Court.”); In re Cypress Semiconductor, Inc. Sec. Litig., 891 F. Supp. 1369, 1374 (N.D. Cal. 1995) (hearsay evidence cannot be considered in summary judgment proceedings), aff’d, 113 F.3d 1240 (9th Cir. 1997). 4 E. Unauthenticated Documents Authentication or identification is a condition precedent to the admissibility of a document. Fed. R. Evid. 901. Under Federal Rule of Civil Procedure 56, evidence in support of a motion for summary judgment is objectionable if it cannot be presented in a form that would be admissible. A document cannot be authenticated by one who does not have personal knowledge of its authenticity. The foundation is laid for receiving a document in evidence by the testimony of a witness with personal knowledge of the facts who attests to the identity and due execution of the document and, where appropriate, its delivery. United States v. Dibble, 429 F.2d 598, 602 (9th Cir. 1970). If there Plaintiffs are unable to show that they could authenticate a document at trial, then the document should not be considered in support of Plaintiffs’ motion for summary judgment. F. Secondary Evidence Rule The “secondary evidence rule” requires that contents of documents must be proved by producing the document itself. Fed. R. Evid. 1001, 1002. OBJECTIONS TO DECLARATIONS FILED IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT II. OBJECTIONS TO THE DECLARATION OF WAYNE J. CAMARA IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment 1. I am the Senior Vice President, Research at ACT. My company produces and publishes the ACT® college readiness assessment — a college admissions and placement test taken [sic by] millions of high school graduates every year. ACT also offers comprehensive assessment, research, information, and program Defendant-Counterclaimant Public Resource’s Objections No Objection. 5 Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections management services to support education and workforce development. As the Senior Vice President of Research, I am responsible for all research and evidence related to the design, development, use, and validation of our assessments and programs. In my position, I serve on the Senior Leadership Team and manage over 110 researchers. 2. I submit this Declaration in support of the motion of the American Educational Research Association, Inc. (“AERA”), the American Psychological Association, Inc. (“APA”), and the National Council on Measurement in Education, Inc. (“NCME”) (collectively, “Plaintiffs” or “Sponsoring Organizations”) for summary judgment and the entry of a permanent injunction. No Objection. 3. Prior to working at ACT, I worked at The College Board, where I held the positions of Vice President, Research and Development (July, 2000 – September, 2013), Executive Director, Office of Research and Development (March, 1997 – June, 2000), and Research Scientist (September, 1994 – February, 1997). No Objection. 4. Before working at The College Board, I worked for APA in the positions of Assistant Executive Director for Scientific Affairs and Executive Director of Science (1992-1994), Director, Scientific Affairs (February, 1989 – August, 1992), and Testing and Assessment Officer (November, 1987 – January, 1989). During my time at APA, I also served as the Project Director for the revision of the 1985 edition of the Standards for Educational and Psychological Testing published in 1999 (the “1999 Standards”). In 1997, I was elected to APA’s Council of Representatives, and I served on the Council from 1997-2003. In April, 2012, I was elected to the AERA Council, serving from April, 2012 to April, 2015 as Vice No Objection. 6 Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections President for Division D. I was also elected to NCME’s Board of Directors, serving on the Board from 2002-2005 and 2009-2012, and served as NCME’s President from 2010-2011. Additionally, I have served on the Management Committee for the Standards from 2005-2015. 5. My curriculum vitae is attached to this Declaration as Exhibit 1. No Objection. 6. I have written extensively on the Standards, as well as other professional and technical guidelines which relate to educational and industrial testing and assessment, including journal articles, book chapters, and paper presentations at national conferences. No Objection. 7. In 1954, APA prepared and published the “Technical Recommendations for Psychological Tests and Diagnostic Techniques.” In 1955, AERA and NCME prepared and published a companion document entitled, “Technical Recommendations for Achievement Tests.” Subsequently, a joint committee of the three organizations modified, revised, and consolidated the two documents into the first Joint Standards. Beginning with the 1966 revision, the Sponsoring Organizations collaborated in developing the “Joint Standards” (or simply, the “Standards”). Each subsequent revision of the Standards has been careful to note that it is a revision and update of the prior version. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to his employment with one of the Plaintiffs. 7 Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 8. Beginning in the mid-1950s, the Sponsoring Organizations formed and periodically reconstituted a committee of highly trained and experienced experts in psychological and educational assessment, charged with the initial development of the Technical Recommendations and then each subsequent revision of the (renamed) Standards. These committees were formed by the Sponsoring Organizations’ Presidents (or their designees), who would meet and jointly agree on the membership. Often a chair or co-chairs of these committees were selected by joint agreement. Beginning with the 1966 version of the Standards, this committee became referred to as the “Joint Committee.” FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 9. Financial and operational oversight for the Standards’ revisions, promotion, distribution, and for the sale of the 1999 and 2014 Standards has been undertaken by a periodically reconstituted Management Committee, comprised of designees of the three Sponsoring Organizations. As noted above, I served on this Management Committee from 2005-2015. FRE 602 Lack of Personal Knowledge. The proffered testimony concerning what occurred before 2005 is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 10. All members of the Joint Committee(s) and the Management Committee(s) are unpaid volunteers. The expenses associated with the ongoing development and publication of the Standards include travel and lodging expenses (for the Joint Committee and Management Committee members), support staff time, printing and shipment of bound volumes, and advertising costs. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues, and it fails to acknowledge or discuss the expenses that a large number of unpaid volunteers and their employers bore in the drafting of the Standards. 11. From the time of their initial creation to the present, the preparation of and periodic revisions to the Standards entail intensive labor and considerable cross-disciplinary expertise. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. FRE 701 Improper Lay Opinion. The proffered testimony contains lay opinion that is not rationally based on the witness’s perception and is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the 8 Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Each time the Standards are revised, the Sponsoring Organizations select and arrange for meetings of the leading authorities in psychological and educational assessments (known as the Joint Committee). During these meetings, certain Standards are combined, pared down, and/or augmented, others are deleted altogether, and some are created as whole new individual Standards. The 1999 version of the Standards is nearly 200 pages, took more than five years to complete, and is the result of work put in by the Joint Committee to generate a set of best practices on educational and psychological testing that are respected and relied upon by leaders in their fields. 9 Defendant-Counterclaimant Public Resource’s Objections witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; and is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment 12. Draft revisions of the 1985 Standards, for what became the 1999 Standards, were widely distributed for public review and comment during the revision process. The Joint Committee received thousands of pages of comments and proposed text revisions from: the membership of the Sponsoring Organizations, scientific, professional, trade and advocacy groups, credentialing boards, state and federal government agencies, test publishers and developers, and academic institutions. While the Joint Committee reviewed and took under advisement these helpful comments, the final language of the 1999 Standards was a product of the Joint Committee members. When the 1985 Standards were revised, more than half the content of the 1999 Standards resulted from newly written prose of the Joint Committee. Defendant-Counterclaimant Public Resource’s Objections FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. For example, the witness does not claim to have reviewed each submission personally, or to have supervised each member of the Joint Committee’s review of the comments. Nor does the witness claim to have personal knowledge of whether prose written by other members of the Joint Committee was “newly written.” FRE 701 Improper Lay Opinion. The proffered testimony contains lay opinion that is not rationally based on the witness’s perception and is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of numerous documents. 13. The Standards originally were created as principles and guidelines – a set of best practices to improve professional practice in testing and assessment across multiple settings, including education and various areas of psychology. The Standards can and should be used as a recommended course of action in the sound and ethical development and use of tests, and also to evaluate the quality of tests and testing practices. Additionally, an essential component of responsible professional practice is maintaining technical competence. Many professional associations also have developed standards and principles of technical practice in assessment. The Sponsoring Organizations’ 10 FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; and is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections Standards have been and still are used for this purpose. 14. The Standards, however, are not simply intended for members of the Sponsoring Organizations, AERA, APA, and NCME. The intended audience of the Standards is broad and cuts across audiences with varying backgrounds and different training. For example, the Standards also are intended to guide test developers, sponsors, publishers, and users by providing criteria for the evaluation of tests, testing practices, and the effects of test use. Test user standards refer to those standards that help test users decide how to choose certain tests, interpret scores, or make decisions based on tests results. Test users include clinical or industrial psychologists, research directors, school psychologists, counselors, employment supervisors, teachers, and various administrators who select or interpret tests for their organizations. There is no mechanism, however, to enforce compliance with the Standards on the part of the test developer or test user. The Standards, moreover, do not attempt to provide psychometric answers to policy or legal questions. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. 15. The Standards promote the development of high quality tests and the sound use of results from such tests. Without such high quality FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter 11 FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory and contains legal conclusions; and is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony on the goals, intent, and operation of the Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections standards, tests might produce scores that are not defensible or accurate, not an adequate reflection of the characteristic they were intended to measure, and not fair to the person tested. Consequently, decisions about individuals made with such test scores would be no better, or even worse, than those made with no test score information at all. Thus, the Standards help to ensure that measures of student achievement are relevant, that admissions decisions are fair, that employment hiring and professional credentialing result in qualified individuals being selected, and patients with psychological needs are diagnosed properly and treated accordingly. Quality tests protect the public from harmful decision making and provide opportunities for education and employment that are fair to all who seek them. and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 16. The Standards apply broadly to a wide range of standardized instruments and procedures that sample an individual’s behavior, including tests, assessments, inventories, scales, and other testing vehicles. The Standards apply equally to standardized multiple-choice tests, performance assessments (including tests comprised of only open-ended essays), and hands-on assessments or simulations. The main exceptions are that the Standards do not apply to unstandardized questionnaires (e.g., unstructured behavioral checklists or observational forms), teachermade tests, and subjective decision processes (e.g., a teacher’s evaluation of students’ classroom participation over the course of a semester). FRE 402 Relevance. The proffered testimony concerning the types of testing the standards apply to does not have any tendency to make a fact of consequence in this litigation more or less probable than it would be without the evidence. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 403 Prejudice. The testimony omits any relevant timeframe and does not specify which editions of the Standards are referred to, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, 12 Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections including because the proffered testimony is conclusory; and is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony on the application of the Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 17. The Standards have been used as a source in developing testing guidelines for such activities as college admissions, personnel selection, test translations, test user qualifications, and computer-based testing. The Standards also have been widely cited to address technical, professional, and operational norms for all forms of assessments that are professionally developed and used in a variety of settings. The Standards additionally provide a valuable public service to state and federal governments as they voluntarily choose to use them. For instance, each testing company, when submitting proposals for testing administration, instead of relying on a patchwork of local, or even individual and proprietary, testing design and implementation criteria, may rely instead on the Sponsoring Organizations’ Standards to afford the best guidance for testing and assessment practices. 13 FRE 402 Relevance. The proffered testimony concerning the use of the Standards does not have any tendency to make a fact of consequence in this litigation more or less probable than it would be without the evidence. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; and is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of documents. 18. The Standards were not created or updated to serve as a legally binding document, in response to an expressed governmental or regulatory need, nor in response to any legislative action or judicial decision. However, the Standards have been cited in judicial decisions related to the proper use and evidence for assessment, as well as by state and federal legislators. These citations in judicial decisions and during legislative deliberations occurred without any lobbying by the Plaintiffs. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues as to which editions of the Standards and which years the witness is referring to. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to the goals of the many authors of the Standards. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception and is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 19. The Sponsoring Organizations do not keep any of the revenues generated from the sales of the Standards. Rather, the income from these sales is used by the Sponsoring Organizations to offset their development and production costs and to generate funds for subsequent revisions. This allows the Sponsoring Organizations to develop up-to-date, high quality Standards that otherwise would not be developed due to the time and effort that goes into producing them. FRE 403 Prejudice. The statement that the Plaintiffs do not “keep” any of the revenues, but use them for certain operating expenses, is incomplete and misleading, because Plaintiffs do keep the revenues but simply earmark them for particular purposes. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally 14 Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections based on the witness’s perception, including because it is speculative; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 20. At one time, funding for the Standards revision process from third party sources (e.g., governmental agencies, foundations, other associations interested in testing and assessment issues, etc.) was raised as a consideration. However, this option was not seriously explored as the potential conflicts of interest in doing so left the Sponsoring Organizations to conclude that the Standards revisions should be selffunding – that is, from the sale of prior editions of the Standards. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues as to which editions of the Standards and which years the witness is referring to. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; and is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 802 Hearsay. The proffered testimony 15 Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections relies on an out-of-court statement that is offered to prove the truth of the matter asserted. 21. In late 2013 and early 2014, the Sponsoring Organizations became aware that the 1999 Standards had been posted on the Internet without their authorization, and that psychology students were obtaining free copies from the posting source. Upon further investigation, the Sponsoring Organizations discovered that Public.Resource.Org, Inc. (“Public Resource”) was the source of the online posting. Accompanying this Declaration as Exhibit MMM is a true copy of a thread of emails exchanged among Laurie Wise, Suzanne Lane, David Frisbie, Jerry Sroufe, Marianne Ernesto, Barbara Plake, and myself2 sent between December 16, 2013 and February 4, 2014, discussing Public Resource’s posting of the 1999 Standards on the Internet, and marked as Exhibit 1185 during my deposition.’ 22. Past harm to the Sponsoring Organizations from Public Resource’s activities includes a lack of greater funding that otherwise would have been available for the update of the Sponsoring Organizations’ Standards from the 1999 to the 2014 versions, due to the reduced volume of sales of the 1999 Standards. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory. FRE 802 Hearsay. The proffered exhibit is an out-of-court statement that is offered to prove the truth of the matter asserted. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is 2 Laurie Wise is the Immediate Past President of NCME and was serving as President of NCME at the time of the email, Suzanne Lane is a member of the Standards Management Committee: David Frisbie also is a member of the Standards Management Committee; Jerry Sroufe is the Director of Government Relations at AERA, Marianne Ernesto is the Director, Testing and Assessment, at APA, and Barbara Plake was Laurie Wise’s co-chair of the Joint Committee for the revision of the 1999 Standards, which ultimately were published in 2014. 16 Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections conclusory. 23. Should Public Resource’s infringement be allowed to continue, the harm to the Sponsoring Organizations, and public at large who rely on the preparation and administration of valid, fair and reliable tests, includes: (i) uncontrolled publication of the 1999 Standards without any notice that those guidelines have been replaced by the 2014 Standards; (ii) future unquantifiable loss of revenue from sales of authorized copies of the 1999 Standards (with proper notice that they are no longer the current version) and the 2014 Standards; and (iii) lack of funding for future revisions of the 2014 Standards and beyond. FRE 403 Prejudice. The 2014 Standards are not at issue in this litigation, and Plaintiffs voluntarily stopped selling the 1999 Standards, the only edition at issue. The witness’s statement is misleading because it suggests that Public Resource’s actions risk depriving Plaintiffs of income from the sale of the 2014 Standards. The witness’s statement is also speculative and risks confusing the issues in this case. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; and is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning harm attributed to Public Resource is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 17 Declaration of Wayne J. Camara In Support of Plaintiffs’ Motion for Summary Judgment 24. Due to the small membership size of NCME, and the relative minor portion of the membership of AERA and APA who devote their careers to testing and assessment, it is highly unlikely that the members of the Sponsoring Organizations will vote for a dues increase to fund future Standards revision efforts if Public Resource successfully defends this case and is allowed to post the Standards online for the public to download or print for free. As a result, the Sponsoring Organizations would likely abandon their practice of periodically updating the Standards and there would be an absence of any authoritative and independent source of sound guidance relating to the development, use, and evaluation of psychological and educational tests. III. Defendant-Counterclaimant Public Resource’s Objections FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. OBJECTIONS TO THE DECLARATION OF MARIANNE ERNESTO IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections 1. I am the Director, Testing and Assessment, at the American Psychological Association, Inc. (“APA”). I have been employed with the APA since May 2001. I submit this Declaration in support of the motion of the American Educational Research Association, Inc. (“AERA”), the APA, and the National Council on Measurement in Education, Inc. (“NCME”) (collectively, “Plaintiffs” or the “Sponsoring Organizations”) for a summary judgment and the entry of a permanent injunction. No Objection. 2. In my role as Director, Testing and Assessment, I serve as APA’s primary authority on all matters that relate to testing and assessment. This subject matter includes No Objection. 18 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections educational testing, clinical assessment, forensic testing and employment testing. I advocate on behalf of APA in matters involving federal or state legislative, regulatory or other policy issues concerning testing and assessment. I coordinate APA’s involvement in testing issues in matters such as governance, executive boards, and managerial bodies. I also manage APA’s responses to internal, public, member and media inquiries regarding testing issues in a manner that is consistent with the Standards for Educational and Psychological Testing (the “Standards”). I advise, counsel and oversee the activities of the APA’s Science Directorate (and in particular its Office of Testing and Assessment) on policy and governance issues related to testing and assessments. I further serve as staff liaison to the APA’s Committee on Psychological Tests an Assessment (“CPTA”). Since 2001, I have served as APA’s primary contact for information concerning the availability and interpretation of the Standards published in 1999, and more recently I have done so regarding the updated Standards published in 2014. 3. APA is a District of Columbia not-for-profit corporation. No Objection. 4. APA is the largest scientific and professional organization representing psychology in the United States. APA is the world’s largest association of psychologists and counts a vast number of researchers, educators, clinicians, consultants and students among its members. APA’s mission is to advance the creation, communication and application of psychological knowledge to benefit society and improve people’s lives. FRE 402 Relevance. The proffered testimony does not have any tendency to make a fact of consequence more or less probable than it would be without the evidence. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally 19 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. 5. In 1954, APA prepared and published the “Technical Recommendations for Psychological Tests and Diagnostic Techniques.” It is my understanding that in 1955 AERA NCME prepared and published a companion document entitled, “Technical Recommendations for Achievement Tests.” FRE 402 Relevance. The witness’s understanding of the facts is not relevant. 6. Subsequently, a joint committee of the three organizations modified, revised and consolidated the two documents into the first Joint Standards. Beginning with the 1966 revision, the three organizations (AERA, APA and NCME) collaborated in developing the “Joint Standards” (or simply, the “Standards”). Each subsequent revision of the Standards has been careful to cite the previous Standards and note that it is a revision and update of that document. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with the APA in May 2001. 20 FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with the APA in May 2001. Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections 7. Beginning in the mid-1950s, AERA, APA, and NCME formed and periodically reconstituted a committee of experts in psychological and educational assessment, charged with the initial development of the Technical Recommendations and then each subsequent revision of the (renamed) Standards. These committees were formed by the Plaintiffs’ Presidents (or their designees), who would meet and jointly agree on the membership. Often a chair or co-chairs of these committees were selected by joint agreement. Beginning with the 1966 version of the Standards, this committee became referred to as the “Joint Committee.” FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with APA in May 2001. 8. Financial and operational oversight for the Standards’ revisions, promotion, distribution, and for the sale of the 1999 and 2014 Standards has been undertaken by a periodically reconstituted Management Committee, comprised of designees of the three Sponsoring Organizations. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with APA in May 2001. 9. All members of the Joint Committee(s) and the Management Committee(s) are unpaid volunteers. The expenses associated with the ongoing development and publication of the Standards include travel and lodging expenses (for the Joint Committee and Management Committee members), support staff time, printing and shipment of bound volumes, and advertising costs. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues, and it fails to acknowledge or discuss the expenses that a large number of unpaid volunteers and their employers bore in the drafting of the Standards. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with APA in May 2001. 21 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections 10. Many different fields of endeavor rely on assessments. The Sponsoring Organizations have ensured that the range of these fields of endeavor is represented in the Joint Committee’s membership e.g., admissions, achievement, clinical counseling, educational, licensing-credentialing, employment, policy, and program evaluation. Similarly, the Joint Committee’s members, who are unpaid volunteers, represent expertise across major functional assessment areas e.g., validity, equating, reliability, test development, scoring, reporting, interpretation, and large scale interpolation. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. 11. From the time of their initial creation to the present, the preparation of and periodic revisions to the Standards entail intensive labor and considerable cross-disciplinary expertise. Each time the Standards are revised, the Sponsoring Organizations select and arrange for meetings of the leading authorities in psychological and educational assessments (known as the Joint Committee). During these meetings, certain Standards are combined, pared down and/or augmented, others are deleted altogether, and some are created as whole new individual Standards. The 1999 version of the Standards is nearly 200 pages and took more than five years to complete. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with APA in May 2001. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with APA in May 2001. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a 22 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections document. 12. The Standards, however, are not simply intended for members of the Sponsoring Organizations, AERA, APA, and NCME. The intended audience of the Standards is broad and cuts across audiences with varying backgrounds and different training. For example, the Standards also are intended to guide test developers, sponsors, publishers, and users by providing criteria for the evaluation of tests, testing practices, and the effects of test use. Test user standards refer to those standards that help test users decide how to choose certain tests, interpret scores, or make decisions based on tests results. Test users include clinical or industrial psychologists, research directors, school psychologists, counselors, employment supervisors, teachers, and various administrators who select or interpret tests for their organizations. There is no mechanism, however, to enforce compliance with the Standards on the part of the test developer or test user. The Standards, moreover, do not attempt to provide psychometric answers to policy or legal questions. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with APA in May 2001, or for the goals or intent of the Standards, which she did not author. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony on the goals, intent, and operation of the Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 13. The Standards apply broadly to a wide FRE 402 Relevance. The proffered testimony 23 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections range of standardized instruments and procedures that sample an individual’s behavior, including tests, assessments, inventories, scales, and other testing vehicles. The Standards apply equally to standardized multiple-choice tests, performance assessments (including tests comprised of only open-ended essays), and hands-on assessments or simulations. The main exceptions are that the Standards do not apply to unstandardized questionnaires (e.g., unstructured behavioral checklists or observational forms), teachermade tests, and subjective decision processes (e.g., a teacher’s evaluation of students’ classroom participation over the course of a semester). concerning the types of testing the standards apply to does not have any tendency to make a fact of consequence in this litigation more or less probable than it would be without the evidence. FRE 403 Prejudice. The testimony omits any relevant timeframe and does not specify which editions of the Standards are referred to, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; and is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony on the application of the Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 14. The Standards have been used to develop testing guidelines for such activities as college FRE 402 Relevance. The proffered testimony concerning the use of the Standards does not 24 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment admissions, personnel selection, test translations, test user qualifications, and computer-based testing. The Standards also have been widely cited to address technical, professional, and operational norms for all forms of assessments that are professionally developed and used in a variety of settings. The Standards additionally provide a valuable public service to state and federal governments as they voluntarily choose to use them. For instance, each testing company, when submitting proposals for testing administration, instead of relying on a patchwork of local, or even individual and proprietary, testing design and implementation criteria, may rely instead on the Sponsoring Organizations’ Standards to afford the best guidance for testing and assessment practices. Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections have any tendency to make a fact of consequence in this litigation more or less probable than it would be without the evidence. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of documents. 15. The Standards were not created or updated to serve as a legally binding document, in response to an expressed governmental or regulatory need, nor in response to any legislative action or judicial decision. However, the Standards have been cited in judicial decisions related to the proper use and evidence for assessment, as well as by state and federal legislators. These citations in judicial decisions and during legislative deliberations occurred without any lobbying by the Plaintiffs. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues as to which editions of the Standards and which years the witness is referring to. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to the goals of the many authors of the Standards. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception and is not 25 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 16. During the discovery phase of this litigation, FRE 1002 Secondary Evidence. The proffered APA located in its archives correspondence testimony is offered to prove the contents of a relating to APA’s support for proposed document. legislation sought to be introduced in 2001 by Senator Paul Wellstone (D-MN) on Fairness and Accuracy in High Stakes Educational Decisions for Students – a suggested amendment to the Elementary and Secondary Education Act (“No Child Left Behind Act”) 147 Cong. Rec. S. 4,644 (daily ed. May 9, 2001). 17. Accompanying this Declaration as Exhibit NN is a true copy of a signed correspondence between Ellen Garrison Ph.D. and Patricia Kobor of APA and Ms. Jill Morningstar, Legislative Assistant to U.S. Senator Paul Wellstone dated April 7, 2000, marked as Exhibit 1109 during my deposition. No Objection. 18. Accompanying this Declaration as Exhibit OO is a true copy of an unsigned correspondence between Ellen Garrison Ph.D. and Patricia Kobor of APA and Ms. Jill Morningstar, Legislative Assistant to U.S. Senator Paul Wellstone dated April 7, 2000, marked as Exhibit 1110 during my deposition. No Objection. 26 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections 19. Accompanying this Declaration as Exhibit PP is a true copy of a signed correspondence between Patricia Kobor and Ellen Garrison, Ph.D. of APA and Ms. Jill Morningstar, Legislative Assistant to U.S. Senator Paul Wellstone dated April 13, 2000, marked as Exhibit 1111 during my deposition. No Objection. 20. Accompanying this Declaration as Exhibit QQ is a true copy of an unsigned correspondence between Raymond D. Fowler, Ph.D. of APA and an unnamed Senator dated May 7, 2001, marked as Exhibit 1114 during my deposition. No Objection. 21. Accompanying this Declaration as Exhibit RR is a true copy of an unsigned correspondence between L. Michael Honaker, Ph.D. of APA and an unnamed Senator dated March 6, 2001, marked as Exhibit 1115 during my deposition. No Objection. 22. Accompanying this Declaration as Exhibit SS is a true copy of a document containing “Highlights of APA’s Involvement in Educational Testing Provisions of the ‘No Child Left Behind Act’” that also contains an unsigned correspondence to an unnamed Senator dated May 7, 2001, marked as Exhibit 1116 during my deposition. No Objection. 23. As noted above, many of these letters are unsigned and are not printed on APA letterhead. Therefore, in accordance with APA practices and protocols, it is likely that the unsigned letters (not printed on letterhead) were internal discussion drafts that were never sent. FRE 403 Prejudice. The witness’s belief as to what is “likely” is less probative than prejudicial, and risks confusing the issues and misleading the factfinder. 27 FRE 602 Lack of Personal Knowledge. The proffered testimony is explicitly speculative and is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to documents Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections created by other individuals, and documents created prior to her employment with APA in May 2001. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 24. Regarding the signed letters that were printed on APA letterhead, they relate to Senator Wellstone’s proposed legislation that tests and assessments administered by the states are of high quality and used appropriately for the benefit of test administrators and test takers. These are goals that are consistent with APA policy as then reflected in the 1999 Standards. Even though Senator Wellstone’s amendments sought, in part, to mandate states’ compliance with the Standards, none of the Sponsoring Organizations actively advocated for this – and in any event Senator Wellstone’s proposed amendment including this language was never enacted into law. Accompanying this Declaration as Exhibit TT is a true copy of 20 U.S.C. § 6301, which is the current version of the legislation Senator Wellstone sought to amend. 28 FRE 402 Relevance. The relevant issue is whether the APA lobbied in support of Senator Wellstone’s proposed amendments mandating compliance with the 1999 Standards, not whether the proposed amendments were unsuccessful notwithstanding the APA’s lobbying activity. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to documents created by other individuals, and documents created prior to her employment with APA in May 2001. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 25. APA’s search of its records did not disclose any further communications with Congress relating to the Standards and, to the best of APA’s knowledge, it has not engaged in communications with Congress regarding citation of the Standards in legislation since 2001. FRE 403 Prejudice. The probative value of the proffered testimony is substantially outweighed by a danger of unfair prejudice, confusing the issues, and misleading the factfinder, because it omits mention of other documents concerning APA’s communication with Congress relating to the Standards that were discussed at deposition, as well as other communications with other policymakers. See, e.g. ICE Exs. 47–49 (Plaintiffs’ briefing on the 2014 Standards at the Russell Senate Office Building on Capitol Hill on September 12, 2014). FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to documents created by other individuals. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the 29 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections scope of Rule 702. 26. APA has not solicited any government agency to incorporate the Standards into the Code of Federal Regulations or other rules of Federal or State agencies. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues as to which editions of the Standards and which years the witness is referring to. Moreover, Plaintiffs refused to provide discovery concerning any edition of the Standards other than the 1999 Standards, and it would be unfairly prejudicial to allow them to introduce testimony on the 2014 Standards or other editions at summary judgment. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to any time period before she was employed by APA in May 2001. FRCP 26(a) and 37 Withheld Evidence. Plaintiffs refused to provide evidence or testimony concerning any edition of the Standards other than the 1999 Edition, and redacted documents that included data concerning the 1985 and 2014 editions of the Standards. See ICE Ex. 62 (Plaintiffs/counterclaim-defendants’ Objections and Answers to Defendant/counterclaim-plaintiff’s First Set of Interrogatories (Nos. 1–10) (objecting to production of documents concerning any publications other than the 1999 Standards and stating that such documents are irrelevant)); ICE Ex. 63 (correspondence PRO counsel identifying earlier versions and redactions as issues in discovery). Plaintiffs should not be allowed to now testify on matters they refused 30 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections to allow discovery into. 27. Rather, in the policymaking arena, APA believes the Standards should be treated as guidelines informing the enactment of legislation and regulations consistent with best practices in the development and use of test – to insure that they are valid, reliable and fair. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. This may, for instance, be APA’s belief now, but was not APA’s belief at the time it lobbied for the 1999 Standards to be mandated by law in 2001. 28. Plaintiffs promote and sell copies of the Standards via referrals to the AERA website, at annual meetings, in public offerings to students, and to educational institution faculty. Advertisements promoting the Standards have appeared in meeting brochures, in scholarly journals, and in the hallways at professional meetings. Accompanying this Declaration as Exhibit UU is a true copy of an advertisement for the 1999 Standards that appeared in the December 1999 issue of APA’s Journal of Educational Psychology. FRE 403 Prejudice. The testimony omits any relevant timeframe and does not specify which editions of the Standards are referred to, which confuses the issues. Plaintiffs ceased selling and promoting the 1999 Standards in 2014, and only resumed selling it in July 2015, 29. Distribution of the Standards is closely monitored, by the Sponsoring Organizations. AERA, the designated publisher of the Standards, sometimes does provide promotional complementary print copies to students or professors. Except for these few complementary print copies, however, the Standards are not given away for free; and certainly they are not made available to the public by any of the three organizations for anyone to copy free of charge. FRE 403 Prejudice. The testimony omits any relevant timeframe and does not specify which editions of the Standards is referred to, which confuses the issues. Plaintiffs ceased selling and promoting the 1999 Standards in 2014, and only resumed selling it in recent months FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to any time period before she was employed by APA in May 2001, and the activities of the other Plaintiffs. 31 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections 30. To date, the Sponsoring Organizations have never posted, or authorized the posting of, a digitized copy of the 1999 Standards on any publicly accessible website. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to any time period before she was employed by APA in May 2001, and the activities of the other Plaintiffs. 31. The Sponsoring Organizations do not keep any of the revenues generated from the sales of the Standards. Rather, the income from these sales is used by the Sponsoring Organizations to offset their development and production costs and to generate funds for subsequent revisions. This allows the Sponsoring Organizations to develop up-to-date, high quality Standards that otherwise would not be developed due to the time and effort that goes into producing them. FRE 403 Prejudice. The statement that the Plaintiffs do not “keep” any of the revenues, but use them for certain operating expenses, is incomplete and misleading, because Plaintiffs do keep the revenues but simply earmark them for particular purposes. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to any time period before she was employed by APA, and the activities of the other Plaintiffs. FRE 701 Improper Lay Opinion. The proffered testimony as to the effects and necessity of Plaintiffs’ financing model is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or 32 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 32. Without receiving at least some moderate income from the sales of the Standards to offset their production costs and to allow for further revisions, it is very likely that the Sponsoring Organizations would no longer undertake to periodically update them, and it is unknown who else would. FRE 403 Prejudice. The 2014 Standards are not implicated by this litigation, and Plaintiffs voluntarily stopped selling the 1999 Standards, the only edition at issue. The witness’s statement is misleading because it suggests without justification or basis that Public Resource’s actions risk depriving Plaintiffs of income from the sale of the 2014 Standards. The witness’s statement is also speculative and risks confusing the issues in this case. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not 33 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections based on the expert’s reliable application of reliable principles and methods to the facts of the case. 33. Due to the relative minor portion of the membership of APA who devote their careers to testing and assessment, it is highly unlikely that the members of APA will vote for a dues increase to fund future Standards revision efforts if Public Resource successfully defends this case and is allowed to post the Standards online for the public to download or print for free. As a result, the Sponsoring Organizations would likely abandon their practice of periodically updating the Standards. FRE 403 Prejudice. The 2014 Standards are not implicated by this litigation, and Plaintiffs voluntarily stopped selling the 1999 Standards, the only edition at issue. The witness’s statement is misleading because it suggests that Public Resource’s actions risk depriving Plaintiffs of income from the sale of the 2014 Standards. The witness’s statement is also speculative and risks confusing the issues in this case. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 34 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections 34. The Joint Committee that authored the 1999 Standards comprised 16 members. Except for Manfred Meier (who could not be located, nor could his heirs), work made-for-hire letters were signed by 13 Joint Committee Members, and posthumous assignments were signed by the heirs of 2 deceased Joint Committee Members, vesting ownership of the copyright to the 1999 Standards in the Sponsoring Organizations. Accompanying this Declaration as Exhibits VV-HHH are the 13 work made-forhire letters signed by Eva Baker, Lloyd Bond, Daniel Goh, Bert Green, Edward Haertel, Jo-Ida Hansen, Suzanne Lane, Sharon Johnson-Lewis, Joseph Matarazzo, Pamela Moss, Esteban Olmedo, Diana Pullin, and Paul Sackett, marked as Exhibits 1065, 1069, 1071, 1072. 1075, 1078, 1082, 1085, 1086, 1089, 1090, 1091, and 1094 during my deposition. Accompanying this Declaration as Exhibits III and JJJ are the posthumous assignments signed by the heirs of Leonard S. Feldt and Charlie Spielberger, marked as exhibits 1070 and 1097 during my deposition. FRE 403 Prejudice. The witness’s testimony is misleading and confuses the issues. 17 individuals participated in the Joint Committee for the 1999 Standards, not 16. Additionally, the witness fails to mention that hundreds of individuals, organizations, and other entities participated in the development of the 1999 Standards in collaboration with the Joint Committee members. See SMF ¶ 9., Moreover, the witness’s opinion as to the legal effect of these alleged “work-made-for-hire letters” and “posthumous assignments” is prejudicial. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of 35 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections the case. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 35. Public Resource posted Plaintiffs’ 1999 Standards to its website and the Internet Archive website without the permission or authorization of any of the Sponsoring Organizations. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 36. Past harm from Public Resource’s infringing activities includes misuse of Plaintiffs’ intellectual property without permission. FRE 403 Prejudice. The witness’s testimony is misleading and confuses the issues by alleging that Public Resource’s activities were infringing, and suggesting that Public Resource should have obtained permission to use the 1999 Standards incorporated by reference and that Plaintiffs could be harmed by such use. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on 36 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 37. Should Public Resource’s infringement be allowed to continue, the harm to the Sponsoring Organizations, and public at large who rely on the preparation and administration of valid, fair and reliable tests, includes: (i) uncontrolled publication of the 1999 Standards without any notice that those guidelines have been replaced by the 2014 Standards; (ii) future unquantifiable loss of revenue from sales of authorized copies of the 1999 Standards (with proper notice that they are no longer the current version) and the 2014 Standards; and (iii) lack of funding for future revisions of the 2014 Standards and beyond. FRE 403 Prejudice. The 2014 Standards are not at issue in this litigation, and Plaintiffs voluntarily stopped selling the 1999 Standards, the only edition at issue. The witness’s statement is misleading because it suggests that Public Resource’s actions risk depriving Plaintiffs of income from the sale of the 2014 Standards. The witness’s statement is also speculative and risks confusing the issues in this case. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of 37 Declaration of Marianne Ernesto In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public.Resource.Org, Inc.’s Objections reliable principles and methods to the facts of the case. IV. OBJECTIONS TO THE DECLARATION OF KURT F. GEISINGER IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 1. I am currently Director of the Buros Center on Testing and W. C. Meierhenry Distinguished University Professor at the University of Nebraska-Lincoln. I submit this Declaration in support of the motion of the American Educational Research Association, Inc. (“AERA”), the American Psychological Association, Inc. (“APA”), and the National Council on Measurement in Education, Inc. (“NCME”) (collectively, “Plaintiffs” or “Sponsoring Organizations”) for summary judgment and the entry of a permanent injunction. No Objection. 2. My curriculum vitae is attached to this Declaration as Exhibit 1. No Objection. 3. I received my doctoral degree in Educational Psychology in 1977 from the Pennsylvania State University, after previously receiving my masters’ degree in Psychology at the University of Georgia and my bachelor’s degree from Davidson College (with honors). I also studied German, Psychology and other topics as an undergraduate at the Phillips Universität in Marburg, Germany and at Harvard University when I attended the Institute for Educational Management in 1995. No Objection. 4. From 2001 to 2006, I served as the Vice President of Academic Affairs and Professor of No Objection. 38 Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections Psychology at the University of St. Thomas in Houston, Texas, where I was responsible for four academic schools, approximately 200 faculty members, and over 4,000 students. From 1997 to 2001, I served as Academic Vice President and Professor of Psychology at Le Moyne College. From 1992 to 1997 I served as Dean of the College of Arts and Sciences and Professor of Psychology at the State University of New York at Oswego. And, from 1977-1992 I served as a Professor of Psychology at Fordham University in New York City, where I served as department chair for the Department of Psychology and director of the Doctoral program in Psychometrics. No Objection. 5. Over the past forty years, I have researched, studied, and taught psychometrics (psychometrics is the quantitative study of tests and measures in terms of the value, usefulness, and interpretation of the results of such measures). I also am a fellow, diplomate, and member of numerous professional societies involving educational and psychological testing, such as the APA (fellow), the American Association for Assessment Psychology (diplomate), the AERA (fellow), and the NCME, as well as other professional associations. I have represented the APA by serving on and chairing the Joint Committee on Testing Practices (which is separate from the APA committee responsible for the 1999 Standards for Educational and Psychological Testing) and have served on the APA’s Committee on Psychological Testing and Assessment. In 2010, I was elected to serve two terms (2006-2008 and 2009-2011) as the representative on the Council of Representatives for the APA’s Division of Evaluation, Measurement and Statistics. My second term was cut short by one year when I was elected to serve as a member-at-large on the APA’s Board of Directors in 2010, a 39 Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections position I held for a three-year term (20112013). 6. I have authored numerous publications about psychological and educational testing. I have worked at the Educational Testing Service (“ETS”), chaired its Technical Advisory Committee for the Graduate Record Examination (“GRE”), served on the Board of Directors for the GRE (a Board that I also chaired), and have been a member of the College Board, (formerly known as the College Entrance Examination Board) for which I served (2000-2002) on its SAT Committee. I recently concluded a four-year term (20112014) on the Advisory Research Committee for the College Board, serving the last two years as its chair. I currently serve on the Technical Advisory Committee for the Educational Records Bureau3 and on Saudi Arabia’s International Advisory Board for its National Center for Assessment and Evaluation. No Objection. 7. In 2010, I was elected to the Council (i.e., Board of Directors) for the International Test Commission—the primary international testing body. In 2012, I was also elected as its Treasurer and to serve on its Executive Council. I am the only American who serves on its Executive Council. No Objection. 8. I was asked to review and share my comments’ [sic] chapters of the 1999 Standards for Educational and Psychological Testing, published jointly by the AERA, the APA, and the NCME (the “1999 Standards”). The Standards4 embody the professionally accepted FRE 402 Relevance / FRE 403 Prejudice. The testimony omits reference to any relevant timeframe, and witness’s use of the term “Standards” without referencing a particular edition or relevant timeframe confuses the issues. 3 The Educational Record Bureau specializes in the development and use of tests and testing products for private and independent educational institutions at the p-12 levels. 4 I use the term “Standards” to refer to the Standards for Educational and Psychological Testing as a whole, not a specific version of the Standards, i.e. 1999 or 2014. 40 Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections practices for testing and measurement. One of the chapters I reviewed was based upon the testing of individuals with disabilities, an area in which I have engaged in research and have served as an expert witness in federal courts as well as state courts in New York, New Jersey, and California. 9. In addition to my 130 plus journal articles and book chapters, I have written, edited, or coedited approximately 15 books and monographs. The vast majority of these publications deal with testing and measurement issues. For example, I have edited two books on the psychological testing of Hispanics and another I co-edited related to fairness in testing. I have also co-edited several books of reviews of published tests and measures. I was also Editor-in-Chief for the three-volume Handbook of Testing and Assessment in Psychology (published by the APA in 2013) and have been editor of the journal Applied Measurement in Education for the past 9 plus years. Taylor & Francis, in conjunction with the Buros Center for Testing publishes this journal. No Objection. 10. I also co-chaired a sub-committee of the APA’s Joint Committee on Testing Practices and the overall committee itself that developed a document on the rights and responsibilities of test takers (1993-2001). This document has been endorsed by a number of professional associations related to proper test use, including the APA, the National Association of School Psychologists, the American Counseling Association, and the NCME. While chairing the Joint Committee on Testing Practices, the committee developed a book entitled Assessing Individuals with Disabilities, in which I wrote a chapter. I also served on a task force charged to illuminate issues related to the testing of individuals with disabilities as well as ethnic minorities. The task force wrote and edited a No Objection. 41 Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections book entitled Test Interpretation and Diversity: Achieving Equity in Assessment, which was published by the APA’s publication unit in 1997. I had three chapters in that volume. 11. I additionally served on an APA task force (2007-2010) that considered the assessment and intervention of individuals with disabilities. The results of our work, Guidelines for the “Assessment of and Intervention with Individuals with Disabilities,” was published in the American Psychologist, the premier publication of the APA (Geisinger et al., 2012) and endorsed as the policy of the APA by its governance. A reference for the American Psychologist article may be found on my curriculum vitae, which is attached as Exhibit 1. No Objection. 12. In the past two years (2014-2015), I have No Objection. served on two task forces related to the use of measures in clinical psychology. One of these has written a policy, recently accepted by the APA’s Board of Directors, that differentiates the use of tests and other measures, for screening and assessment, two highly related types of testing, but which differ in specificity and focus. Tests are usually standardized measures that are given to a number of people for a specific purpose. A bar examination would be an example of a test. Measures are other variables yielding typically quantitative values that are used to evaluate a person and include tests. A bathroom scale results in a measure (weight), but would not normally be considered as a test. 13. During 2013-2014, I served on a committee of the Institute of Medicine (a component of the National Academy of Sciences) that evaluated the use of psychological and clinical neuropsychological measures by the Social Security Administration in determining 42 No Objection. Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections disability status. The final report, entitled Psychological Testing in the Service of Disability Determination, has been published by the National Academy of Sciences and is also available from the Institute of Medicine’s website. 14. For approximately four years (2008-2012), I jointly represented three professional associations (the AERA, the APA, and the NCME) in developing the International Standards Organization’s (“ISO”) first standard on psychological testing. The results of the work of the committee that engaged in this activity was ISO Standard 10677. The standard is divided into two parts. The first establishes requirements and guidance for a client working with a service provider to carry out the assessment of an individual, a group, or an organization for work-related purposes. ISO 10667-1:2011 enables the client to base its decisions on sound assessment results. ISO 10667-1:2011 also specifies the responsibilities of a service provider in terms of the assessment methods and procedures that can be carried out for various work-related purposes made by or affecting individuals, groups or organizations. No Objection. 15. I also built or helped to build a number of testing measures. Specifically, I served as the primary consultant on a number of civil service examinations given in New York City for police officers, sergeants, lieutenants, and captains, fire fighters, fire lieutenants, fire captains, sanitation supervisors, and a variety of other civil service occupations over a period of at least a decade ending in 1992. I sometimes defended these measures in court. I also represented the Public Service Alliance of Canada against the Public Service of Canada in two cases related to their national testing efforts and assisted Disability Rights Advocates with regard to several testing disputes concerning FRE 402 Relevance. The witness’s prior experience as an expert on testing issues is not relevant to his opinions in this case, which concerns alleged harm to Plaintiffs. 43 Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections individuals with disabilities. See Exh. 1. 16. In recent years, my primary efforts have been to assure testing fairness for those with disabilities, language minorities, and ethnic minorities. FRE 402 Relevance. The witness’s prior experience with testing issues is not relevant to his opinions in this case, which concerns alleged harm to Plaintiffs. 17. I first learned about the Standards for Educational and Psychological Testing while I was in my first or second year of graduate school. They are widely discussed in classes on testing and testing practice and treated with great respect. Some graduate programs and courses require that students purchase the Standards as part of their coursework and education. In teaching graduate classes on topics related to testing and associated with the Standards, I often refer to them, building the thoughts and approaches described in the Standards, as well as specific standards, into my lectures and classes. I expect students to purchase and read the Standards in a number of the classes I taught. When writing chapters and articles on such topics as test validity, test reliability, and test fairness—all topics I have discussed in writing—I frequently refer to the Standards to check my use of language, my interpretations, and to check that I am not omitting a topic of importance relevant to the specific publication. Also, when building tests, such as the Police and Fire Department Civil Service tests I helped construct for the City of New York, or when serving on technical advisory committees for the well-known SAT and GRE committees and boards, I refer to the Standards frequently. Usually, in meetings I attempt to express what I believed to be best practices, and then would “back up” my beliefs with quotes from the specific and relevant standards. Perhaps my greatest use of the Standards has occurred in my legal defense of specific tests or in my critique of particular uses of some tests, both of which I have engaged in FRE 402 Relevance. The witness’s prior experience as an expert on testing issues is not relevant to his opinions in this case, which concerns alleged harm to Plaintiffs. 44 FRE 403 Prejudice. The testimony omits reference to any relevant timeframe, and witness’s use of the term “Standards” without referencing a particular edition or relevant timeframe confuses the issues. Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections during my career as an expert witness. 18. The ultimate advantages of the Standards in my opinion are that they are written and edited by first-rate professionals covering a number of the representative fields in which testing and assessment are primarily employed, they are thoroughly and publicly vetted by other professionals, and they are openly discussed during the revision process at many professional conferences. The resultant document becomes a living document of best practices. That the members of the committee drafting the Standards are generally extremely highly respected professionals in the field of testing and testing practice also provides the Standards great credibility. Given my experience over the last 10 years as Director of the Buros Center for Testing, thought of by many as the Consumer Reports of the testing industry, and my service as the co-editor of the Mental Measurements Yearbooks, where commercially available tests are evaluated, I can state categorically that the Standards serve as the primary basis for all test evaluations. The other editors of these Yearbooks and I refer to the Standards with great frequency to determine and assure ourselves that the comments made by reviewers are consistent with the Standards and that the reviews themselves are based upon principles supported by, and coherent with, the Standards. The Standards originally were created as principles and guidelines – a set of best practices to improve professional practice in testing and assessment across multiple settings, including education and various areas of psychology. The Standards can and should be used as a recommended course of action in the sound and ethical development and use of tests, and also to evaluate the quality of tests and testing practices. Additionally, an essential component of responsible professional practice is maintaining technical competence. Many 45 FRE 402 Relevance. The witness’s prior experience as an expert on testing issues is not relevant to his opinions in this case, which concerns alleged harm to Plaintiffs. FRE 403 Prejudice. The testimony omits reference to any relevant timeframe, and witness’s use of the term “Standards” without referencing a particular edition or relevant timeframe confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections professional associations also have developed standards and principles of technical practice in assessment. The Sponsoring Organizations’ Standards have been and still are used for this purpose. 19. The Standards, however, are not simply intended for members of the Sponsoring Organizations: AERA, APA, and NCME. The intended audience of the Standards is broad and cuts across audiences with varying backgrounds and different training. For example, the Standards also are intended to guide test developers, sponsors, publishers, and users by providing criteria for the evaluation of tests, testing practices, and the effects of test use. Test user-oriented standards refer to those standards that help test users decide how to choose certain tests, interpret scores, or make decisions based on test results. Test users include clinical or industrial psychologists, research directors, school psychologists, counselors, employment supervisors, teachers, and various administrators who select or interpret tests for their organizations. There is no mechanism, however, to enforce compliance with the Standards on the part of the test developer or test user. The Standards, moreover, do not attempt to provide psychometric answers to policy or legal questions. They do not themselves set requirements, but serve to distribute best practices and procedures. FRE 403 Prejudice. The federal government requires compliance with the 1999 Standards through Title 34 Section 668.146 of the Code of Federal Regulations, and the witness’s discussion of compliance mechanisms by other parties is irrelevant and confuses the issues. The testimony omits reference to any relevant timeframe, and witness’s use of the term “Standards” without referencing a particular edition or relevant timeframe confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with APA, or for the goals or intent of the Standards, which she did not author. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 46 Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 20. The Standards apply broadly to a wide range of standardized instruments and procedures that sample an individual’s behavior, including tests, assessments, inventories, scales, and other testing vehicles. The Standards apply equally to standardized multiple-choice tests, performance assessments (including tests comprised of only open-ended essays), and hands-on assessments or simulations. The main exceptions are that the Standards do not apply to unstandardized questionnaires (e.g., unstructured behavioral checklists or observational forms), teachermade tests, and subjective decision processes (e.g., a teacher’s evaluation of students’ classroom participation over the course of a semester). FRE 402 Relevance. The proffered testimony concerning the types of testing the standards apply to does not have any tendency to make a fact of consequence in this litigation more or less probable than it would be without the evidence. FRE 403 Prejudice. The testimony omits any relevant timeframe and does not specify which editions of the Standards are referred to, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 702 Unreliable Expert Opinion. The proffered testimony on the application of the Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 21. The Standards have been used to develop testing guidelines for such activities as college admissions, personnel selection, test translations, test user qualifications, and computer-based testing. The Standards also have been widely cited to address technical, professional, and operational norms for all forms of assessments that are professionally developed and used in a variety of settings. The Standards additionally provide a valuable public service to state and federal governments as they 47 FRE 402 Relevance. The proffered testimony concerning the use of the Standards does not have any tendency to make a fact of consequence in this litigation more or less probable than it would be without the evidence. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections voluntarily choose to use them. For instance, each testing company, when submitting proposals for testing administration, instead of relying on a patchwork of local, or even individual and proprietary, testing design and implementation criteria, may rely instead on the Sponsoring Organizations’ Standards to afford the best guidance for testing and assessment practices. and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 22. The Sponsoring Organizations do not keep any of the revenues generated from the sales of the Standards. Rather, the income from these sales is used by the Sponsoring Organizations to offset their development and production costs and to generate funds for subsequent revisions. This strategy allows the Sponsoring Organizations to develop up-to-date, high quality Standards that otherwise would not be developed due to the time and effort that goes into producing them. FRE 403 Prejudice. The statement that the Plaintiffs do not “keep” any of the revenues, but use them for certain operating expenses, is incomplete and misleading, because Plaintiffs do keep the revenues but simply earmark them for particular purposes. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of documents. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning the business model used for sale and development of the Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 23. Without the sales revenue from prior Standards versions (because – if Public Resource succeeds in this litigation – this publication will be made freely available online), it is extremely unlikely that future FRE 403 Prejudice. The 2014 Standards are not at issue in this litigation, and Plaintiffs voluntarily stopped selling the 1999 Standards, the only edition at issue. The witness’s statement is misleading because it suggests 48 Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections updates to the Standards will be undertaken. This well-informed opinion is made because NCME is too small an organization to financially support periodic updates of the Standards, AERA does not have the budget for it, and an insufficient number of psychometricians are members of APA for it to justify the ongoing expenditures. Charging extra membership fees to fund ongoing updates to the Standards would never happen, because the governing bodies of AERA, APA and NCME would not vote for it. If these Sponsoring Organizations ceased updating the Standards, it is unlikely that other organizations would step in and continue the effort. Moreover, there are no other organizations with the expertise in their memberships to populate such a committee or task force. that Public Resource’s actions risk depriving Plaintiffs of income from the sale of the 2014 Standards. The witness’s statement is also speculative and risks confusing the issues in this case. 24. There simply is no way for Plaintiffs to calculate with any degree of certainty the number of university/college professors, students, testing companies and others who would have purchased Plaintiffs’ Standards but for their wholesale posting on Defendant’s https://law.resource.org website and the Internet Archive http://archive.org website. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning the economic substitution effect of Public Resource’s posting of the 1999 Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 25. In Fiscal Year (“FY”) 2011 to FY 2012, as FRE 403 Prejudice. The probative value of the 49 FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning the business model used for sale and development of the Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment compared to FY 2011, the Sponsoring Organizations experienced a 34% drop in sales of the 1999 Standards. In FY 2013, sales of the 1999 Standards remained at their low level from the prior fiscal year (See F. Levine Declaration, ¶ 18, Exh. OOO). For a publication with the longevity of the 1999 Standards, one otherwise would expect to see a gradual decline in sales year-over-year; not the precipitous drop in sales experienced by the 1999 Standards in 2012 and 2013 - even considering that updated Standards were published in 2014. It is also clear that this drop did not occur due to the expected publication of the 2014 Standards, because they were actually due to be published more than a year earlier. Thus, one would have expected such a drop to occur perhaps in 2010 or 2011. Defendant-Counterclaimant Public Resource’s Objections proffered testimony on sales is substantially outweighed by a danger of unfair prejudice, confusing the issues, and misleading the factfinder, because the witness’s conclusions are both contrary to fact and mischaracterize the evidence. What the witness presents as sales data is actually gross revenue data. The witness fails to provide context as to the general decline in both sales and revenues for the 1999 Standards that began prior to Public Resource’s posting of the 1999 Standards. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning the sales of the 1999 Standards and the economic substitution effect of Public Resource’s posting of the 1999 Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or 50 Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 26. Past harm from Public Resource’s infringing activities includes misuse of Plaintiffs’ intellectual property without permission, lost sales that cannot be totally accounted for – due to potentially infinite Internet distribution, especially by psychometrics students, and lack of funding that otherwise would have been available for the update of the Sponsoring Organizations’ Standards from the 1999 to the 2014 versions. FRE 403 Prejudice. The witness’s statement regarding “potentially infinite Internet distribution” has no factual basis and invites speculation through unrealistic and bombastic terminology. The probative value of the proffered testimony is substantially outweighed by a danger of unfair prejudice, confusing the issues, and misleading the factfinder. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning harm attributed to Public Resource is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 27. Should Public Resource’s infringement be allowed to continue, the harm to the Sponsoring Organizations, and public at large who rely on the preparation and administration of valid, fair and reliable tests, includes: (i) uncontrolled publication of the 1999 Standards without any 51 FRE 403 Prejudice. The 2014 Standards are not at issue in this litigation, and Plaintiffs voluntarily stopped selling the 1999 Standards, the only edition at issue. The witness’s statement is misleading because it suggests that Public Resource’s actions risk depriving Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment notice that those guidelines have been replaced by the 2014 Standards; (ii) future unquantifiable loss of revenue from sales of authorized copies of the 1999 Standards (with proper notice that they are no longer the current version) and the 2014 Standards; and (iii) lack of funding for future revisions of the 2014 Standards and beyond. Defendant-Counterclaimant Public Resource’s Objections Plaintiffs of income from the sale of the 2014 Standards. The witness’s statement is also speculative and risks confusing the issues in this case. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning harm attributed to Public Resource is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 52 Declaration of Kurt F. Geisinger In Support of Plaintiffs’ Motion for Summary Judgment 28. The harm caused to the public by publication of out-of-date Standards (not labeled as such) will be significant, because the testing and assessment fields are constantly changing, given updates in testing technology and ever-evolving collective thought on the validity, reliability and fairness of tests. Members of the public who would be harmed by discontinued updates of the Standards include psychometrics professors, students and professionals, as well as test developers, administrators and takers. V. Defendant-Counterclaimant Public Resource’s Objections FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning harm attributed to Public Resource is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. OBJECTIONS TO THE DECLARATION OF PLAINTIFFS’ LEAD COUNSEL JONATHAN HUDIS IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION Declaration of Jonathan Hudis In Support of Plaintiffs’ Motion for Summary Judgment 1. I am a partner with Quarles & Brady LLP, lead counsel to Plaintiffs, AMERICAN EDUCATIONAL RESEARCH ASSOCIATION, INC. (“AERA”), AMERICAN PSYCHOLOGICAL ASSOCIATION, INC. (“APA”) and NATIONAL COUNCIL ON MEASUREMENT IN EDUCATION, INC. (“NCME”) (collectively, “Plaintiffs”) in the captioned action. I submit this Declaration in support of Plaintiffs’ motion for summary judgment and entry of a permanent injunction against Defendant, Public.Resource.Org, Inc. Defendant-Counterclaimant Public Resource’s Objections No Objection. 53 Declaration of Jonathan Hudis In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections (“Defendant” or “Public Resource”). 2. Accompanying this Declaration as Exhibit A is a true copy of the transcript from the deposition of Carl Malamud (“Malamud”), taken in his personal capacity and as the Fed.R.Civ.P. 30(b)(6) representative of Defendant (see transcript, pp. 14-22), on May 12, 2015 (the “Malamud/Public Resource Deposition”). Public Resource hereby preserves the objections that its counsel made at the time of the deposition. 3. Accompanying this Declaration as Exhibit B is a true copy of the Articles of Incorporation of Public Resource, filed with the California Secretary of State on April 13, 2007, marked as Exhibit 16 during the Malamud/Public Resource Deposition. No Objection. 4. Accompanying this Declaration as Exhibit C is a true copy of the Bylaws of Public Resource, having a “last revised” date of April 18, 2007 (see p. 23), marked as Exhibit 17 during the Malamud/Public Resource Deposition. No Objection. 5. Accompanying this Declaration as Exhibit D are true copies of the home page and “About” page from Public Resource’s website, https://public.resource.org, marked as Exhibits 19 and 20 during the Malamud/Public Resource Deposition. Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 6. Accompanying this Declaration as Exhibit E is a true copy of a representative list of projects Malamud/Public Resource has been involved in and publications he has written as author or coauthor, marked as Exhibit 15 during the Malamud/Public Resource Deposition. Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 7. Accompanying this Declaration as Exhibit F is a true copy of a documented Kickstarter crowd-funding campaign launched by Public Resource in 2013, to obtain outside financial support for copying and posting third party Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 54 Declaration of Jonathan Hudis In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections standards and codes to the https://public.resource.org website. These captured Kickstarter web pages were marked as Exhibit 27 during the Malamud/Public Resource Deposition. 8. Accompanying this Declaration as Exhibit G is a true copy of the “Geneva” chapter from Malamud’s book entitled Exploring the Internet: A Technical Travelogue, published in 1993, marked as Exhibit 22 during the Malamud/Public Resource Deposition. Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 9. Accompanying this Declaration as Exhibit H is a true copy of Malamud, C., Liberating America’s Secret, For-Pay Laws, boingboing, March 19, 2012, marked as Exhibit 25 during the Malamud/Public Resource Deposition. Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 10. Accompanying this Declaration as Exhibit I is a true copy of Garfield, B., Making Laws More Public Transcript - On The Media, interview of Carl Malamud, The Media, April 13, 2012, marked as Exhibit 24 during the Malamud/Public Resource Deposition. Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 11. Accompanying this Declaration as Exhibit J No Objection. to this Declaration is a true and accurate copy of “Public Safety Codes Incorporated by Law,” appearing on Defendant’s website at http://law.resource.org/pub/us/code/safety.html (last visited December 17, 2015). 12. Accompanying this Declaration as Exhibit K to this Declaration is a true and accurate copy of “Public Safety Standards United States (Federal Government),” appearing on Defendant’s website at http://law.resource.org/pub/us/cfr/manifest.us. html (last visited December 17, 2015). No Objection. 13. Accompanying this Declaration as Exhibit L Plaintiffs did not refile this document. Public to this Declaration is a true and accurate copy of Resource reserves its prior objections stated in 55 Declaration of Jonathan Hudis In Support of Plaintiffs’ Motion for Summary Judgment the Register of Copyrights’ online abstract for U.S. Copyright Registration No. TX 5-920-538, for the work “Safety standard for belt manlifts: ASME A90.1-2003.” Defendant-Counterclaimant Public Resource’s Objections Dkt. 69-4. 14. Accompanying this Declaration as Plaintiffs did not refile this document. Public Exhibit M to this Declaration is a true and Resource reserves its prior objections stated in accurate copy of the Register of Copyrights’ Dkt. 69-4. online abstract for U.S. Copyright Registration No. TX 5-181-138, for the work “Guidelines for the definition of onshore gas gathering lines.” 15. Accompanying this Declaration as Exhibit N to this Declaration is a true and accurate copy of the Register of Copyrights’ online abstract for U.S. Copyright Registration No. TX 427-109, for the work “Official methods of analysis of the Association of Official Analytical Chemists.” Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 16. Accompanying this Declaration as Exhibit O to this Declaration is a true and accurate copy of the Register of Copyrights’ online abstract for U.S. Copyright Registration No. TX 1-142-464, for the work “Classification in mental retardation.” Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 17. Accompanying this Declaration as Exhibit P Plaintiffs did not refile this document. Public to this Declaration is a true and accurate copy of Resource reserves its prior objections stated in the Register of Copyrights’ online abstract for Dkt. 69-4. U.S. Copyright Registration No. TX 2-953-680, for the work “Glazing manual.” 18. Accompanying this Declaration as Exhibit Q to this Declaration is a true and accurate copy of the Register of Copyrights’ online abstract for U.S. Copyright Registration No. TX 6-062-476, for the work “Mobile and locomotive cranes : ASME B30.5-2004.” Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 19. Accompanying this Declaration as Exhibit R to this Declaration is a true and accurate copy of the Register of Copyrights’ Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 56 Declaration of Jonathan Hudis In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections online abstract for U.S. Copyright Registration No. TX 5-434-639, for the work “Drinking water system components: health effects: American national standard/NSF international standard for drinking water additives: ANSI/INSF 61-2001.” 20. Accompanying this Declaration as Exhibit S Plaintiffs did not refile this document. Public to this Declaration is a true and accurate copy of Resource reserves its prior objections stated in the Register of Copyrights’ online abstract for Dkt. 69-4. U.S. Copyright Registration No. TX 5-902-199, for the work “Minimum design loads for buildings and other structures.” 21. Accompanying this Declaration as Exhibit T Public Resource hereby preserves the is a true copy of DEFENDANTobjections made in its interrogatory responses. COUNTERCLAIMANT PUBLIC.RESOURCE.ORG, INC.’S AMENDED RESPONSES TO PLAINTIFFS’ COUNTERDEFENDANTS’ FIRST SET OF INTERROGATORIES (NOS 1-8), marked as Exhibit 29 during the Malamud/Public Resource Deposition. 22. Accompanying this Declaration as Exhibit U is a true copy of Public Resource’s receipt, dated May 17, 2015, for its purchase of Plaintiff’s Standards for Educational and Psychological Testing (1999 ed.), marked as Exhibit 30 during the Malamud/Public Resource Deposition. No Objection. 22. Accompanying this Declaration as Exhibit U is a true copy of Public Resource’s receipt, dated May 17, 2015, for its purchase of Plaintiff’s Standards for Educational and Psychological Testing (1999 ed.), marked as Exhibit 30 during the Malamud/Public Resource Deposition. No Objection. 57 Declaration of Jonathan Hudis In Support of Plaintiffs’ Motion for Summary Judgment 23. Accompanying this Declaration as Exhibit V is a true copy of Plaintiffs’ Standards for Educational and Psychological Testing (1999 ed.), marked as Exhibit 31 during the Malamud/Public Resource Deposition. Defendant-Counterclaimant Public Resource’s Objections No Objection. 24. Accompanying this Declaration as No Objection. Exhibit W is a true copy of a letter and Freedom of Information Action (“FOIA”) request dated July 14, 2009 from Public Resource to the General Counsel of the National Archives, requesting a copy of, inter alia, Plaintiffs’ 1999 Standards for free or at reduced cost pursuant to a “fee waiver,” marked as Exhibit 32 during the Malamud/Public Resource Deposition. 25. Accompanying this Declaration as Exhibit X is a true copy of letter dated August 3, 2009 from the National Archives to Public Resource, marked as Exhibit 33 during the Malamud/Public Resource Deposition, in which the National Archives denies Public Resource’s FOIA request of Exhibit W above. No Objection. 27. Accompanying this Declaration as Exhibit Z Public Resource hereby preserves the is a true copy of the transcript from the objections that its counsel made at the time of deposition of James R. Fruchterman the deposition. (“Fruchterman”), Defendant’s Expert, taken on September 8, 2015 (the “Fruchterman Deposition”). 28. Accompanying this Declaration as Exhibit AA is a true copy of the Fruchterman Expert Report, marked as part of Exhibit 64 during the Fruchterman Deposition. No Objection. 29. Accompanying this Declaration as Exhibit BB is a true copy of portions of the transcript from the deposition of Christopher Butler (“Butler”), Office Manager of the Internet Archive (see transcript at pp. 5, 7-8 and 28-30), taken on December 2, 2014 (the “Butler/Internet Archive Deposition”). Public Resource hereby preserves the objections that its counsel made at the time of the deposition. 58 Declaration of Jonathan Hudis In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 30. Accompanying this Declaration as Exhibit CC is a true copy of a Declaration of Internet Archive (C. Butler) and Stipulation of the Parties (the “Butler/Internet Archive Declaration”) signed by Butler on January 20, 2015, subsequent to and as a supplementation of the Butler/Internet Archive Deposition. No Objection. 31. Accompanying this Declaration as Exhibit DD is a true copy of Internet Archive’s Terms of Use dated March 10, 2001, marked as Exhibit 5 during the Butler/Internet Archive Deposition. Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 32. Accompanying this Declaration as Exhibit EE is a true copy of Internet Archive’s Item History for gov.law.aera.standards 1999, marked as Exhibit 7 during the Butler/Internet Archive Deposition. No Objection. 33. Accompanying this Declaration as Exhibit FF is a true copy of Internet Archive’s Logs pertaining to the Item History for gov.law.aera.standards.1999, marked as Exhibit 8 during the Butler/Internet Archive Deposition. No Objection. 34. Accompanying this Declaration collectively as Exhibit GG are a [sic] true copies of screen captures of Plaintiffs’ 1999 Standards in the form that they were uploaded by Public Resource to the Internet Archive website, marked as Exhibit 6 during the Butler/Internet Archive Deposition. FRE 403 Prejudice. The description of this document is misleading and risks confusing the issues because it is erroneous. At deposition, the Rule 30(b)(6) representative of the Internet Archive identified these as screenshots of a details page depicting in part select pages from the 1999 Standards. ICE Ex. 61 (Butler Dep. 57:07–59:09). 35. Accompanying this Declaration as Exhibit HH is a true copy of DEFENDANT PUBLIC.RESOURCE.ORG, INC.’S RESPONSES TO PLAINTIFFS’ FIRST REQUESTS FOR ADMISSIONS, SET ONE (NOS. 1-8). Public Resource hereby preserves the objections that it made in its responses to Plaintiffs’ requests for admissions. 59 Declaration of Jonathan Hudis In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 36. On December 15, 2014, Plaintiffs filed a motion to compel discovery of, inter alia, documentation verifying when Public Resource published or posted Plaintiffs’ 1999 Standards to one of Public Resource’s websites, as well documentation verifying the number of times Plaintiffs’ 1999 Standards were viewed on, accessed from or downloaded from one of Public Resource’s websites (i.e., Public Resource’s Internet server logs). The parties’ motion papers pertaining to Plaintiffs’ discovery motion may [sic] found on the Court’s docket at Dkt. Nos. 27, 29 and 30. Five months later, and without explanation, the Court (Robinson, M-J) denied these parts of Plaintiffs’ discovery motion (Court Order, May 20, 2015, Dkt. No. 49). FRE 402 Relevance. The proffered testimony does not have any tendency to make a fact of consequence more or less probable than it would be without the evidence. 37. Accompanying this Declaration as Exhibit II is a true copy of Internet Archive’s screen capture of its query results to determine from its records the download count for the item with the identifier gov.law.aera.standards.1999, marked as Exhibit 11 during the Butler/Internet Archive Deposition. FRE 403 Prejudice. The Rule 30(b)(6) representative of the Internet Archive specified that “download” in this context referred to any access of the web address, not necessarily a download onto a hard drive or other medium, and such access could be from either human beings or from Internet crawling robots (automated programs like webcrawlers), or uploaders, or internal visits from Internet Archive processes or staff. ICE Ex. 61 (Butler Dep. 126:02–126:21). The probative value of the proffered testimony is substantially outweighed by a danger of unfair prejudice, confusing the issues, and misleading the factfinder. FRE 403 Prejudice. Plaintiffs’ motion was granted in part and denied in part after a full briefing and opportunity to argue before the Court. Plaintiffs had an opportunity to appeal the ruling and did not do so, and should not now attempt to cast doubt on the Court’s ruling and sow speculation. The probative value of the proffered testimony is substantially outweighed by a danger of unfair prejudice, confusing the issues, misleading the factfinder, and wasting time. 38. Accompanying this Declaration as No Objection. Exhibit JJ is a true copy of an e-mail dated December 16, 2013 from Mr. John Neikirk, Director of Publications of Plaintiff AERA, to Carl Malamud, requesting removal of Plaintiffs’ 1999 Standards from Public Resource’s https://law.resource.org website, marked as Exhibit 39 during the Malamud/Public Resource Deposition. 60 Declaration of Jonathan Hudis In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 39. Accompanying this Declaration as Exhibit KK is a true copy of a letter dated December 19, 2013 from Carl Malamud (on Public Resource stationery) refusing to remove Plaintiffs’ 1999 Standards from Public Resource’s https://law.resource.org website, marked as Exhibit 40 during the Malamud/Public Resource Deposition. No Objection. 40. Accompanying this Declaration as Exhibit LL is a true copy of an e-mail dated June 10, 2014 from the undersigned to Carl Malamud regarding the initiation of this lawsuit, marked as Exhibit 42 during the Malamud/Public Resource Deposition. No Objection. 41. Accompanying this Declaration as Exhibit MM is a true copy of a memorandum on Public Resource letterhead, signed by Carl Malamud on June 12, 2014, undertaking to remove Plaintiffs’ 1999 Standards from Public Resource’s https://law.resource.org website and from the Internet Archive https://archive.org website pending the outcome of this litigation, marked as Exhibit 43 during the Malamud/Public Resource Deposition. No Objection. 61 VI. OBJECTIONS TO THE DECLARATION OF FELICE J. LEVINE IN SUPPORT OF PLAINTIFFS MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 1. I am the Executive Director of the American Educational Research Association, Inc. (“AERA”) I have been employed by the AERA since May 2002. I submit this Declaration in support of the motion of the AERA, the American. Psychological Association, Inc. (“APA”), and the National Council on Measurement in Education, Inc. (“NCME”) (collectively, “Plaintiffs” or “Sponsoring Organizations”) for summary judgment and the entry of a permanent injunction. No Objection. 2. As set forth in the AERA Bylaws, the Executive Director is the chief executive officer of the Association. In that capacity, I am responsible for all programmatic, financial, administrative, staffing, and managerial responsibilities of the AERA. I also advise on and implement the policies that guide our organization. No Objection. 3. As publisher, the AERA has provided general No Objection. oversight since November 1999 for the production, printing, sales, and marketing of the “Standards for Educational and Psychological Testing” (the “Standards”), and for the fiscal management of the revenue and expenditure of funds and resources of that publication. AERA was selected to serve as publisher by the Management Committee of the three Sponsoring Organizations. As the Executive Director of the AERA, I have administrative oversight over all of AERA’s implementation of its responsibilities regarding the Standards 4. AERA is a District, of Columbia not-forprofit corporation. No Objection. 62 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 5. AERA is the major national scientific society for research on education and learning. AERA’s mission is to advance knowledge about education, to encourage scholarly inquiry related to education, and to promote the use of research to improve education and serve the public good. No Objection. 6. In 1955, Plaintiffs AERA and NCME prepared and published a companion document to APA’s “Technical Recommendations for Psychological Tests and Diagnostic Techniques” (published in 1954), entitled, “Technical Recommendations for Achievement Tests.” Subsequently, a joint committee of the three organizations modified, revised, and consolidated the two documents into the first Joint Standards. Beginning with the 1966 revision, the Sponsoring Organizations collaborated in developing the “Joint Standards” (or simply, the “Standards”). Each subsequent revision of the Standards has been careful to note that it is a revision and update of the prior version. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with AERA in May 2002. 7. Beginning in the mid-1950s, the Sponsoring Organizations formed and periodically reconstituted a committee of highly trained and experienced experts in psychological and educational assessment, charged with the initial development of the Technical Recommendations and then each subsequent revision of the (renamed) Standards. These committees were formed by the Sponsoring Organizations’ Presidents (or their designees), who would meet and jointly agree on the membership. Often a chair or co-chairs of these committees were selected by joint agreement. Beginning with the 1966 version of the Standards, this committee became referred to as the “Joint Committee.” FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with AERA in May 2002. 63 FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 8. Financial and operational oversight for the Standards’ revisions, promotion, distribution, and for the sale of the 1999 and 2014 Standards has been undertaken by a periodically reconstituted Management Committee, comprised of the designees of the three Sponsoring Organizations. As Publisher of the 1999 and 2014 Standards, AERA works in consultation with the Management Committee to implement its managerial guidance. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with AERA in May 2002. 9. All members of the Joint Committee(s) and the Management Committee(s) are unpaid volunteers. The expenses associated with the ongoing development and publication of the Standards include travel and lodging expenses (for the Joint Committee and Management Committee members), support staff time, production, printing and shipment of bound volumes, and advertising costs. For the 2014 Standards, the production, printing and shipment of bound volumes, and advertising costs, are paid for by the publisher, AERA. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues, and it fails to acknowledge or discuss the expenses that a large number of unpaid volunteers and their employers bore in the drafting of the Standards. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with AERA in May 2002. 10. Many different fields of endeavor rely on assessments. The Sponsoring Organizations have ensured that the range of these fields of endeavor is represented in the Joint Committee’s membership – e.g., admissions, achievement, clinical counseling, educational, licensing-credentialing, employment, policy, and program evaluation. Similarly, the Joint Committee’s members, who are unpaid volunteers, represent expertise across major functional assessment areas – e.g., validity, equating, reliability, test development, scoring, reporting, interpretation, and large scale interpolation. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, 64 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections or other specialized knowledge within the scope of Rule 702. 11. From the time of their initial creation to the present, the preparation of and periodic revisions to the Standards entail intensive labor and considerable cross-disciplinary expertise. Each time the Standards are revised, the Sponsoring Organizations select and arrange for extensive meetings of and work by the leading authorities in psychological and educational assessments (known as the Joint Committee). During these meetings, certain Standards are combined, pared down, and/or augmented, others are deleted altogether, and some are created as whole new individual Standards. The 1999 version of the Standards is nearly 200 pages, took more than five years to complete. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 12. The Standards were not created or updated to serve as a legally binding document, in response to an expressed governmental or regulatory need, nor in response to any legislative action or judicial decision. However, the Standards have been cited in judicial decisions related to the proper use and evidence for assessment, as well as by state and federal legislators. These citations in judicial decisions and during legislative deliberations occurred without any lobbying by the Plaintiffs. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues as to which editions of the Standards and which years the witness is referring to. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to the goals of the many authors of the Standards. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception and is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, 65 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections including because the proffered testimony is conclusory. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 13. AERA has not solicited any government agency to incorporate the Standards into the Code of Federal Regulations or other rules of’ Federal or State agencies. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues as to which editions of the Standards and which years the witness is referring to. Moreover, Plaintiffs refused to provide discovery concerning any edition of the Standards other than the 1999 Standards, and it would be unfairly prejudicial to allow them to introduce testimony on the 2014 Standards or other editions at summary judgment. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to any time period before she was employed by AERA in May 2002. FRCP 26(a) and 37 Withheld Evidence. Plaintiffs refused to provide evidence or testimony concerning any edition of the Standards other than the 1999 Edition, and redacted documents that included data concerning the 1985 and 2014 editions of the Standards. See ICE Ex. 62 (Plaintiffs/counterclaim-defendants’ Objections and Answers to Defendant/counterclaim-plaintiff’s First Set of Interrogatories (Nos. 1–10) (objecting to production of documents concerning any publications other than the 1999 Standards and stating that such documents are irrelevant)); ICE Ex. Ex. 63 (correspondence PRO counsel identifying earlier versions and redactions as issues in discovery). Plaintiffs should not be 66 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections allowed to now testify on matters they refused to allow discovery into. 14. Plaintiffs promote and sell copies of the Standards via referrals to the AERA website, at annual meetings, in public offerings to students, and to educational institution faculty. Advertisements promoting the Standards have appeared in meeting brochures, in scholarly journals, and in the hallways at professional meetings. Accompanying this Declaration as Exhibit NNN is a true copy of advertisements promoting the 1999 Standards, marked as Exhibit 1218 during my deposition. FRE 403 Prejudice. The testimony omits any relevant timeframe and does not specify which editions of the Standards are referred to, which confuses the issues. Plaintiffs ceased selling and promoting the 1999 Standards in 2014, and only resumed selling it in July 2015, 15. All copies of the Standards bear a copyright notice. FRE 402 Relevance. The proffered testimony does not have any tendency to make a fact of consequence more or less probable than it would be without the evidence. FRE 403 Prejudice. The testimony does not specify which editions of the Standards the witness is referring to, which confuses the issues. Plaintiffs refused to provide discovery concerning any edition of the Standards other than the 1999 Standards, and it would be unfairly prejudicial to allow them to introduce testimony on other editions of the Standards at summary judgment. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 16. Distribution of the Standards is closely monitored by the Sponsoring Organizations. AERA, the designated publisher of the Standards, sometimes provides promotional complementary print copies to students or professors. Except for these few complementary print copies, however, the Standards are not given away for free; and certainly they are not made available to the public by any of the three organizations for anyone to copy free of charge. 67 FRE 403 Prejudice. The testimony omits any relevant timeframe and does not specify which editions of the Standards is referred to, which confuses the issues. Plaintiffs ceased selling and promoting the 1999 Standards in 2014, and only resumed selling it in recent months Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections To date, AERA has never posted, or authorized the posting of, a digitized copy of the 1999 Standards on any publicly accessible website. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to any time period before she was employed by AERA in May 2002, and the activities of the other Plaintiffs. 17. The 1999 Standards have been sold at retail prices ranging from $25.95 to $49.95 per copy. From 2000 to 2014, except for the near twoyear period during which Public Resource posted unauthorized copies online and sales diminished significantly, income generated from sales of the 1999 Standards, on average, had been approximately in excess of $127,000 per year. FRE 403 Prejudice. The “average” gross revenue that the witness describes fails to note the fluctuations in sales revenue during the first 12 years that the 1999 Standards were on sale, nor the general downward trend of sales revenue. Nor does the witness’s testimony explain how she arrived at her calculations. The probative value of the proffered testimony is substantially outweighed by a danger of unfair prejudice, confusing the issues, and misleading the factfinder. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help 68 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 18. Accompanying this Declaration as Exhibit OOO is a true copy of AERA’s Statement of Revenue and Expenses for the Standards from FY2000 to December 31, 2013, marked as Exhibit 1211 during my deposition. No Objection. 19. After the 2014 Standards were published in the late summer of 2014, AERA for a time discontinued sales of the 1999 Standards. This was to encourage sales of the newly-revised edition – the 2014 Standards. Accompanying this Declaration as Exhibit PPP is a true copy of the publication page for the 1999 Standards on the AERA website as of May 4, 2015 showing that the 1999 Standards were not available for sale at that time, marked as Exhibit 1196 during my deposition. FRE 403 Prejudice. At deposition, AERA’s Rule 30(b)(6) witness 20. However, so long as purchasers are made aware that it is no longer the current edition, the 1999 Standards do have an enduring value for those in the testing and assessment profession who (i) need to know the state of best testing practices as they existed between 1999 and 2014, (ii) believe they still may be held accountable to the guidance of the 1999 Standards even now, and/or (iii) study the changes in best testing and assessment practices over time. For this reason, in the summer of 2015 AERA resumed sales of the 1999 Standards. Accompanying this Declaration as 69 Plaintiffs should not now be allowed to introduce testimony on this subject, as the probative value of the proffered testimony is substantially outweighed by a danger of unfair prejudice. FRE 403 Prejudice. Exhibit QQQ is dated “12/17/2015” and does not show that the 1999 Standards were available for sale as of the summer of 2015, and the testimony is therefore misleading. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections Exhibit QQQ is a true copy of the publication page for the 1999 Standards on the AERA website as updated during the summer of 2015, showing that the 1999 Standards are available for sale. based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 21. All revenue from the sale of the 1999 Standards above expenses is used to cover the publishing costs of the Standards and for the preparation of subsequent editions of the Standards. The Sponsoring Organizations do not distribute any proceeds from the sales of the Standards to the Sponsoring Organizations. Rather, the income from these sales is used by the Sponsoring Organizations to offset their development and production costs and to generate funds for subsequent revisions. This allows the Sponsoring Organizations to develop up-to-date, high quality Standards that otherwise would not be developed due to the time and effort that goes into producing them. 70 FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to any time period before she was employed by AERA in May 2002, and the activities of the other Plaintiffs. FRE 701 Improper Lay Opinion. The proffered testimony as to the effects and necessity of Plaintiffs’ financing model is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 22. Without receiving revenue from the sales of the Standards to offset their preparation costs and to allow for further revisions, it is very likely that the Sponsoring Organizations would no longer undertake to periodically update them, and it is unknown who else would. FRE 403 Prejudice. The 2014 Standards are not implicated by this litigation, and Plaintiffs voluntarily stopped selling the 1999 Standards, the only edition at issue. The witness’s statement is misleading because it suggests that Public Resource’s actions risk depriving Plaintiffs of income from the sale of the 2014 Standards. The witness’s statement is also speculative and risks confusing the issues in this case. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The 71 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 23. The Sponsoring Organizations decided on a model of self-funding of revisions of the Standards; that is, from the sale of prior editions of the Standards. Funding for the Standards revision process from third party sources (e.g., governmental agencies, foundations, other associations interested in testing and assessment issues, etc.) was rejected because of the appearance or potential of conflicts of interest and the importance of users of the Standards being able to trust in their scientific integrity. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues as to which editions of the Standards and which years the witness is referring to. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to any time period before she was employed by AERA in May 2002, and the activities of the other Plaintiffs. FRE 701 Improper Lay Opinion. The proffered testimony as to the effects and necessity of Plaintiffs’ financing model is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 802 Hearsay. The proffered testimony relies on an out-of-court statement that is offered to prove the truth of the matter asserted. 72 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 24. Due to the relative minor portion of the membership of AERA who devote their careers to testing and assessment, it is highly unlikely that the members of AERA will vote for a dues increase to fund future Standards revision efforts if Public Resource successfully defends this case and is allowed to post the Standards online for the public to download or print for free. As a result, the Sponsoring Organizations would likely abandon their practice of periodically updating the Standards. FRE 403 Prejudice. The 2014 Standards are not implicated by this litigation, and Plaintiffs voluntarily stopped selling the 1999 Standards, the only edition at issue. The witness’s statement is misleading because it suggests that Public Resource’s actions risk depriving Plaintiffs of income from the sale of the 2014 Standards. The witness’s statement is also speculative and risks confusing the issues in this case. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 73 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 25. The Standards were registered with the No Objection. U.S. Register of Copyrights under Registration Number TX 5-100-196, having an effective date of December 8, 1999. Accompanying this Declaration as Exhibit RRR is a true copy of the December 8, 1999 Copyright Certificate of Registration for the 1999 Standards. 26. A supplementary copyright registration for the Standards was issued by the U.S. Register of Copyrights under Supplementary Registration Number TX 6-434-609, having an effective date of February 25, 2014. This Supplementary Registration was obtained to correct an error in the listing of copyright ownership in Registration Number TX 5-100196. Accompanying this Declaration as Exhibit SSS is a true copy of the February 25, 2014 Supplementary Copyright Certificate of Registration for the 1999 Standards. Plaintiffs did not refile this document. Public Resource reserves its prior objections stated in Dkt. 69-4. 27. The Joint Committee that authored the 1999 Standards comprised 16 members. FRE 403 Prejudice. At deposition, Plaintiffs’ Rule 30(b)(6) representative on the subject of copyright ownership and assignment stated Additionally, the witness fails to mention that hundreds of individuals, organizations, and other entities participated in the development of the 1999 Standards in collaboration with the Joint Committee members. See SMF ¶ 9. The probative value of the proffered testimony is substantially outweighed by a danger of unfair prejudice, confusing the issues, and misleading the factfinder. FRE 602 Lack of Personal Knowledge. The witness was not hired until May 2002, years after the Joint Committee for the 1999 Standards completed its work. The proffered testimony is not based on the witness’s 74 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 28. Accompanying this Declaration as Exhibit TTT is a true copy of the 1999 Standards. No Objection. 29. Public Resource posted Plaintiffs’ 1999 Standards to its website and the Internet Archive website without the permission or authorization of any of the Sponsoring Organizations. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to the activities of individuals at APA and NCME. 30. The Sponsoring Organizations can only speculate on the number of electronic copies of the 1999 Standards that were made and distributed to others by the original Internet users who accessed the unauthorized copies that Public Resource posted to its site and the Internet Archive site. There simply is no way for the Sponsoring Organizations to calculate with any degree of certainty the number of university/college professors, students, testing companies and others who would have purchased Plaintiffs’ Standards but for their wholesale posting on Defendant’s https://law.resource.org website and the Internet Archive http://archive.org website. FRE 403 Prejudice. Plaintiffs have the burden of proving infringement, and lacking evidence, cannot simply invite the Court to “speculate” as to the existence and number of downstream copies. The probative value of the proffered testimony is substantially outweighed by a danger of unfair prejudice, confusing the issues, misleading the factfinder, and wasting time. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. 75 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 31. In December 2013, Plaintiff AERA requested in writing that Public Resource remove the 1999 Standards from its online postings. Accompanying this Declaration as Exhibit UUU is a true copy of a letter sent from John S. Neikirk, Director of Publications at AERA, to Carl Malamud of Public Resource regarding the posting of the 1999 Standards at https://law.resource.org/pub/us/cfr/ibr/001/aera. standards.1999.pdf, marked as Exhibit 1228 during my deposition. No Objection. 32. Had Public Resource not promised to remove the 1999 Standards from its law.resource.org website and the Internet Archive website while this lawsuit is pending, and followed through with, these promises, the Sponsoring Organizations seriously contemplated moving forward with a motion to preliminary [sic] enjoin Public Resource from maintaining the unauthorized postings of electronic copies of the 1999 Standards on the Internet, and delaying publication of the 2014 Standards. FRE 402 Relevance. The proffered testimony does not have any tendency to make a fact of consequence more or less probable than it would be without the evidence. 33. By June 2014, when Public Resource finally removed its online postings of the 1999 Standards, the damage already had been done. In Fiscal Year (“FY”) 2011 to FY 2012, as compared to FY 2011, the Sponsoring FRE 403 Prejudice. The probative value of the proffered testimony on sales is substantially outweighed by a danger of unfair prejudice, confusing the issues, and misleading the factfinder, because the witness’s conclusions 76 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Organizations experienced a 34% drop in sales of the 1999 Standards. In FY 2013, sales of the 1999 Standards remained at their low level from the prior fiscal year. Defendant-Counterclaimant Public Resource’s Objections are both contrary to fact and mischaracterize the evidence. What the witness presents as sales data is actually gross revenue data. The witness fails to provide context as to the general decline in both sales and revenues for the 1999 Standards that began prior to Public Resource’s posting of the 1999 Standards. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning the sales of the 1999 Standards and harm attributed to Public Resource is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or 77 Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 34. This is notable, given that Public Resource posted the Standards to the Internet in 20122013, and that the Sponsoring Organizations’ updated Standards were not published until the summer of 2014. FRE 403 Prejudice. The witness does not specify when precisely Public Resource posted the 1999 Standards, and invites speculation as to a connection between Public Resource’s actions and the sales of the 1999 Standards, which were in decline prior to the posting of the 1999 Standards. The probative value of the proffered testimony on sales is substantially outweighed by a danger of unfair prejudice, confusing the issues, and misleading the factfinder. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. 35. Past harm from Public Resource’s infringing activities includes lost sales that cannot be totally accounted for — due to potentially infinite Internet distribution; for example, by psychometrics students — and a lack of funding that otherwise would have been 78 FRE 403 Prejudice. The witness’s statement regarding “potentially infinite Internet distribution” has no factual basis and invites speculation through unrealistic and bombastic terminology. The probative value of the proffered testimony is substantially Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment available for the update of the Sponsoring Organizations’ Standards from the 1999 to the 2014 versions. Defendant-Counterclaimant Public Resource’s Objections outweighed by a danger of unfair prejudice, confusing the issues, and misleading the factfinder. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning harm attributed to Public Resource is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 36. Should Public Resource’s infringement be allowed to continue, the harm to the Sponsoring Organizations, and public at large who rely on the preparation and administration of valid, fair and reliable tests, includes: (i) uncontrolled publication of the 1999 Standards without any notice that those guidelines have been replaced by the 2014 Standards; (ii) future unquantifiable loss of revenue from sales of authorized copies 79 FRE 403 Prejudice. The 2014 Standards are not at issue in this litigation, and Plaintiffs voluntarily stopped selling the 1999 Standards, the only edition at issue. The witness’s statement is misleading because it suggests that Public Resource’s actions risk depriving Plaintiffs of income from the sale of the 2014 Standards. The witness’s statement is also speculative and risks confusing the issues in Declaration of Felice J. Levine In Support of Plaintiffs’ Motion for Summary Judgment of the 1999 Standards (with proper notice that they are no longer the current version) and the 2014 Standards; and (iii) lack of funding for future revisions of the 2014 Standards and beyond. Defendant-Counterclaimant Public Resource’s Objections this case. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony concerning harm attributed to Public Resource is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. VII. OBJECTIONS TO THE DECLARATION OF DIANNE L. SCHNEIDER IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION Declaration of Dianne L. Schneider In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 1. I am a Senior Human Capital Consultant at Personnel Decisions Research Institute No Objection. 80 Declaration of Dianne L. Schneider In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections (“PDRI”). My work for PDRI includes providing consulting services, in areas such as performance management and career development, to a variety of public and private sector clients. I submit this Declaration in support of the motion of the American Educational Research Association, Inc. (“AERA”), the American Psychological Association, Inc. (“APA”), and the National Council on Measurement in Education, Inc. (“NCME”) (collectively, “Plaintiffs” or “Sponsoring Organizations”) for summary judgment and the entry of a permanent injunction. 2. Prior to working at PDRI, from 1998 through 2012, I worked as a private consultant, providing consulting services for the APA and for Valtera, Inc. in the areas of leader, assessment and development, and psychological testing and assessment. Between 2009 and 2012, I worked as a consultant and a project coordinator for APA during the revision by the Joint Committee of the Sponsoring Organizations of the 1999 edition of the Standards for Educational and Psychological Testing (the “Standards”) that were published in 2014. Prior to becoming a private consultant, from 1994 through 1998, I worked as a Testing and Assessment Officer at the APA. Prior to becoming a Testing and Assessment Officer, from 1992 to 1994, I worked as a Research Officer for APA. From 1993 through 1998, I also participated as a staff liaison for the Joint Committee during their revision of the 1985 edition of the Standards that were produced in published in 1999. No Objection. 3. My work for the revision of the 1985 Standards published in 1999, and my work for the revision of the 1999 Standards published in 2014, consisted of providing administrative No Objection. 81 Declaration of Dianne L. Schneider In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections support to the project, such as arranging meeting logistics, taking notes and preparing minutes from the meetings, and managing committee correspondence including sending draft versions of the Standards for comment and compiling input from the public reviews. 4. Financial and operational oversight for the Standards’ revisions, promotion, distribution, and for the sale of the 1999 and 2014 Standards has been undertaken by a periodically reconstituted Management Committee, comprised of the designees of the three Sponsoring Organizations. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 5. All members of the Joint Committee(s) and the Management Committee(s) are unpaid volunteers. The expenses associated with the ongoing development and publication of the Standards include travel and lodging expenses (for the Joint Committee and Management Committee members), support staff time, printing and shipment of bound volumes, and advertising costs. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues, and it fails to acknowledge or discuss the expenses that a large number of unpaid volunteers and their employers bore in the drafting of the Standards. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 6. Draft revisions of the 1985 Standards, for No Objection. what became the 1999 Standards, were widely distributed for public review and comment three times during this revision effort to gauge whether the testing community believed the revised drafts to be current and inclusive of the topics at issue. 7. The Joint Committee received thousands of pages of comments and proposed text revisions from: the membership of the Sponsoring Organizations, scientific, professional, trade and advocacy groups, credentialing boards, state 82 FRE 602 Lack of Personal Knowledge. The proffered testimony as to the Joint Committee’s use of submitted comments and language is not based on the witness’s personal knowledge of the matter and the proffering Declaration of Dianne L. Schneider In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections and federal government agencies, test publishers and developers, and academic institutions. While the Joint Committee reviewed and took under advisement these helpful comments, the final language of the 1999 Standards was a product of the Joint Committee members. party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. VIII. OBJECTIONS TO THE DECLARATION OF LAURESS L. WISE IN SUPPORT OF PLAINTIFFS MOTION FOR SUMMARY JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 1. I am the Immediate Past President of the National Council on Measurement in Education, Inc. (“NCME”). I have been a member of this organization for approximately 30 years. I previously was the President of NCME from April 2014 through April 2015, and Vice President of this organization from April 2013 through April 2014. I submit this Declaration in support of the motion of the American Educational Research Association, Inc. (“AERA”), the American Psychological Association, Inc. (“APA”), and the NCME (collectively, “Plaintiffs” or “Sponsoring Organizations”) for summary judgment and the entry of a permanent injunction. No Objection. 2. I also am a principal scientist with the Human Resources Research Organization (“HumRRO”), spending full time on research No Objection. 83 Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections and evaluation projects relating to educational measurement. I previously served as HumRRO CEO for 13 years, combining management and research activities and, before that, directed research and development for the Armed Services Vocational Aptitude Battery for the Department of Defense. Before that I spent 16 years as a researcher for the American Institutes for Research, rising to the position of Director of Research. I am also a member of both AERA and APA. 3. NCME is a District of Columbia not-forprofit corporation. No Objection. 4. NCME is a professional organization for individuals involved in assessment, evaluation, testing, and other aspects of educational measurement. NCME’s members are involved in the construction and use of standardized tests; new forms of assessment, including performance-based assessment; program design; and program evaluation. No Objection. 5. In 1955, AERA and NCME prepared and published a companion document to APA’s “Technical Recommendations for Psychological Tests and Diagnostic Techniques” (published in 1954), entitled “Technical Recommendations for Achievement Tests.” FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 6. Subsequently, a joint committee of the three organizations modified, revised and consolidated the two documents into the first Joint Standards. Beginning with the 1966 revision, the Sponsoring Organizations collaborated in developing the “Joint Standards” (or simply, the “Standards”). Each subsequent revision of the Standards has been careful to note that it is a revision and update of that document 84 Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 7. Beginning in the mid-1950s, the Sponsoring Organizations formed and periodically reconstituted a committee of experts in psychological and educational assessment, charged with the initial development of the Technical Recommendations and then each subsequent revision of the (renamed) Standards. These committees were formed by the three organizations’ Presidents (or their designees), who would meet and jointly agree on the membership. Often a chair or co-chairs of these committees were selected by joint agreement. Beginning with the 1966 version of the Standards, this committee became referred to as the “Joint Committee.” For example, I was the co-chair of the Joint Committee for the 2014 edition of the Standards. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 8. Financial and operational oversight for the Standards’ revisions, promotion, distribution, and for the sale of the 1999 and 2014 Standards has been undertaken by a periodically reconstituted Management Committee, comprised of designees of the three Sponsoring Organizations. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 9. All members of the Joint Committee(s) and the Management Committee(s) are unpaid volunteers. The expenses associated with the ongoing development and publication of the Standards include travel and lodging expenses (for the Joint Committee and Management Committee members), support staff time, printing and shipment of bound volumes, and advertising costs. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues, and it fails to acknowledge or discuss the expenses that a large number of unpaid volunteers and their employers bore in the drafting of the Standards. 10. Many different fields of endeavor rely on assessments. The Sponsoring Organizations have ensured that the range of these fields of FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 602 Lack of Personal Knowledge. The 85 Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections endeavor is represented in the Joint Committee’s membership – e.g., admissions, achievement, clinical counseling, educational, licensing-credentialing, employment, policy, and program evaluation. Similarly, the Joint Committee’s members represent expertise across major functional assessment areas – e.g., validity, equating, reliability, test development, scoring, reporting, interpretation, large scale interpolation and cognitive behavioral therapy. proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 11. From the time of their initial creation to the present, the preparation and periodic revisions to the Standards entail intensive labor and considerable cross-disciplinary expertise. Each time the Standards are revised, the Sponsoring Organizations select and arrange for meetings of the leading authorities in psychological and educational assessments (known as the Joint Committee). During these meetings, certain Standards are combined, pared down, and/or augmented, others are deleted altogether, and some are created as whole new individual Standards. The 1999 version of the Standards is nearly 200 pages, and took more than five years to complete – resulting from work put in by the Joint Committee to generate a set of best practices on educational and psychological testing that are respected and relied upon by leaders in their fields. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. 12. The Standards originally were created as principles and guidelines – a set of best practices to improve professional practice in testing and assessment across multiple settings, including education and various areas of FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. 86 FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections psychology. The Standards can and should be used as a recommended course of action in the sound and ethical development and use of tests, and also to evaluate the quality of tests and testing practices. Additionally, an essential component of responsible professional practice is maintaining technical competence. Many professional associations also have developed standards and principles of technical practice in assessment. The Sponsoring Organizations’ Standards have been and still are used for this purpose. personal knowledge of this matter. 13. The Standards, however, are not simply intended for members of the Sponsoring Organizations, AERA, APA, and NCME. The intended audience of the Standards is broad and cuts across audiences with varying backgrounds and different training. For example, the Standards also are intended to guide test developers, sponsors, publishers, and users by providing criteria for the evaluation of tests, testing practices, and the effects of test use. Test user standards refer to those standards that help test users decide how to choose certain tests, interpret scores, or make decisions based on tests results. Test users include clinical or industrial psychologists, research directors, school psychologists, counselors, employment supervisors, teachers, and various administrators who select or interpret tests for their organizations. There is no mechanism, however, to enforce compliance with the Standards on the part of the test developer or test user. The Standards, moreover, do not attempt to provide psychometric answers to policy or legal questions. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. 87 FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; and is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly for any time period prior to her employment with APA, or for the goals or intent of the Standards, which she did not author. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony on the goals, intent, and operation of the Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 14. The Standards promote the development of high quality tests and the sound use of results from such tests. Without such high quality standards, tests might produce scores that are not defensible or accurate, not an adequate reflection of the characteristic they were intended to measure, and not fair to the person tested. Consequently, decisions about individuals made with such test scores would be no better, or even worse, than those made with no test score information at all. Thus, the Standards help to ensure that measures of student achievement are relevant, that admissions decisions are fair, that employment hiring and professional credentialing result in qualified individuals being selected, and patients with psychological needs are diagnosed properly and treated accordingly. Quality tests protect the public from harmful decision making and provide opportunities for education and employment that are fair to all who seek them. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 15. The Standards apply broadly to a wide range of standardized instruments and procedures that sample an individual’s behavior, including tests, assessments, inventories, scales, and other testing vehicles. The Standards apply equally to standardized multiple-choice tests, performance assessments (including tests comprised of only open-ended essays), and hands-on assessments or simulations. The main exceptions are that the FRE 402 Relevance. The proffered testimony concerning the types of testing the standards apply to does not have any tendency to make a fact of consequence in this litigation more or less probable than it would be without the evidence. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 403 Prejudice. The testimony omits any relevant timeframe and does not specify which editions of the Standards are referred to, which 88 Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Standards do not apply to unstandardized questionnaires (e.g., unstructured behavioral checklists or observational forms), teachermade tests, and subjective decision processes (e.g., a teacher’s evaluation of students’ classroom participation over the course of a semester). Defendant-Counterclaimant Public Resource’s Objections confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; and is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony on the application of the Standards is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of reliable principles and methods to the facts of the case. 16. The Standards have been used to develop testing guidelines for such activities as college admissions, personnel selection, test translations, test user qualifications, and computer-based testing. The Standards also have been widely cited to address technical, professional, and operational norms for all forms of assessments that are professionally developed and used in a variety of settings. The Standards additionally provide a valuable public service to state and federal governments as they 89 FRE 402 Relevance. The proffered testimony concerning the use of the Standards does not have any tendency to make a fact of consequence in this litigation more or less probable than it would be without the evidence. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment voluntarily choose to use them. For instance, each testing company, when submitting proposals for testing administration, instead of relying on a patchwork of local, or even individual and proprietary, testing design and implementation criteria, may rely instead on the Sponsoring Organizations’ Standards to afford the best guidance for testing and assessment practices. Defendant-Counterclaimant Public Resource’s Objections and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of documents. 17. The Standards were not created or updated to serve as a legally binding document, in response to an expressed governmental or regulatory need, nor in response to any legislative action or judicial decision. However, the Standards have been cited in judicial decisions related to the proper use and evidence for assessment, as well as by state and federal legislators. These citations in judicial decisions and during legislative deliberations occurred without any lobbying by the Plaintiffs. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues as to which editions of the Standards and which years the witness is referring to. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to the goals of the many authors of the Standards. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception and is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. 90 Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 18. NCME has never communicated with Congress for the purpose of encouraging the enactment of the Standards into law. FRE 403 Prejudice. The probative value of the proffered testimony is substantially outweighed by a danger of unfair prejudice, confusing the issues, and misleading the factfinder, because it omits mention of NCME’s participation in a briefing on the Standards at Capitol Hill. See, e.g. ICE Exs. and 47–49. 19. Additionally, NCME has never solicited any government agency to incorporate the Standards into the Code of Federal Regulations or other rules of Federal or State agencies. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues as to which editions of the Standards and which years the witness is referring to. Moreover, Plaintiffs refused to provide discovery concerning any edition of the Standards other than the 1999 Standards, and it would be unfairly prejudicial to allow them to introduce testimony on the 2014 Standards or other editions at summary judgment. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRCP 26(a) and 37 Withheld Evidence. Plaintiffs refused to provide evidence or testimony concerning any edition of the Standards other than the 1999 Edition, and redacted documents that included data concerning the 1985 and 2014 editions of the Standards. See ICE Ex. 62 (Plaintiffs/counterclaim-defendants’ Objections and Answers to Defendant/counterclaim-plaintiff’s First Set of Interrogatories (Nos. 1–10) (objecting to production of documents concerning any publications other than the 1999 Standards and stating that such documents are irrelevant)); ICE Ex. Ex. 63 (correspondence PRO counsel identifying earlier versions and redactions as issues in discovery). Plaintiffs should not be 91 Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections allowed to now testify on matters they refused to allow discovery into. 20. In the policymaking arena, NCME believes the Standards should be treated as guidelines informing the enactment of legislation and regulations consistent with best practices in the development and use of tests – to insure that they are valid, reliable and fair. FRE 403 Prejudice. The testimony omits any relevant timeframe, which confuses the issues. 21. The Sponsoring Organizations promote and sell copies of the Standards via referrals to the AERA website, at annual meetings, in public offerings to students, and to educational institution faculty. Advertisements promoting the Standards have appeared in meeting brochures, in scholarly journals, and in the hallways at professional meetings. Accompanying this Declaration as Exhibit KKK is a true copy of advertisements for the 1999 Standards published in NCME’s Journal of Educational Management. These advertisements were produced at Bates Nos. AERA_ APA_NCME_0031444-0031451. FRE 403 Prejudice. The testimony omits any relevant timeframe and does not specify which editions of the Standards are referred to, which confuses the issues. Plaintiffs ceased selling and promoting the 1999 Standards in 2014, and only resumed selling it in July 22. Distribution of the Standards is closely monitored by the Sponsoring Organizations. AERA, the designated publisher of the Standards, sometimes does provide promotional complementary print copies to students or professors. Except for these few complementary print copies, however, the Standards are not given away for free; and certainly they are not made available to the public by any of the three organizations for anyone to copy free of charge. FRE 403 Prejudice. The testimony omits any relevant timeframe and does not specify which editions of the Standards is referred to, which confuses the issues. Plaintiffs ceased selling and promoting the 1999 Standards in 2014, and only resumed selling it in recent months FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter, particularly as to the activities of the other Plaintiffs. 92 Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 23. To date, NCME has never posted, or authorized the posting of, a digitized copy of the 1999 Standards on any publicly accessible website. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 24. Without receiving at least some moderate income from the sales of the Standards to offset their production costs and to allow for further revisions, it is very likely that the Sponsoring Organizations would no longer undertake to periodically update them, and it is unknown who else would. FRE 403 Prejudice. The 2014 Standards are not implicated by this litigation, and Plaintiffs voluntarily stopped selling the 1999 Standards, the only edition at issue. The witness’s statement is misleading because it suggests without justification or basis that Public Resource’s actions risk depriving Plaintiffs of income from the sale of the 2014 Standards. The witness’s statement is also speculative and risks confusing the issues in this case. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory; or is based on scientific, technical, or other specialized knowledge within the scope of Rule 702. FRE 702 Unreliable Expert Opinion. The proffered testimony is an expert opinion by a witness who is not qualified as an expert by knowledge, skill, experience, training, or education. The testimony further will not help the trier of fact to understand the evidence or to determine a fact in issue; is not based on sufficient facts or data; is not the product of reliable principles and methods; and is not based on the expert’s reliable application of 93 Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections reliable principles and methods to the facts of the case. 25. In late 2013 and early 2014, the Sponsoring Organizations became aware that the 1999 Standards had been posted on the Internet without their authorization, and that students were obtaining free copies from the posting source. Upon further investigation, the Sponsoring Organizations discovered that Public Resource was the source of the online posting. FRE 602 Lack of Personal Knowledge. The proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory. FRE 802 Hearsay. This testimony refers to an out-of-court statement that is offered to prove the truth of the matter asserted. 26. Public Resource posted Plaintiffs’ 1999 Standards to its website and the Internet Archive website without the permission or authorization of any of the Sponsoring Organizations. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. 27. Plaintiffs have been made aware that at least some of those users who obtained the 1999 Standards for free from Public Resource did so to avoid paying the modest sale price for authorized print copies. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 701 Improper Lay Opinion. The proffered testimony is a lay opinion that is not rationally based on the witness’s perception; is not helpful to clearly understanding the witness’s testimony or to determining a fact in issue, including because the proffered testimony is conclusory. FRE 802 Hearsay. The proffered testimony is an out-of-court statement that is offered to prove the truth of the matter asserted. 94 Declaration of Lauress L. Wise In Support of Plaintiffs’ Motion for Summary Judgment Defendant-Counterclaimant Public Resource’s Objections 28. Accompanying this Declaration as Exhibit LLL is a true copy of an e-mail dated March 5, 2014 from Gregory J. Cizek to me regarding a student not purchasing the 1999 Standards because “they [were] available for free online” at https://law.resource.org/pubtus/cfr/ibr/001/aera. standards.1999.pdf.” This e-mail exchange was marked as Exhibit 1252 during my deposition. FRE 403 Prejudice. The proffered exhibit is so heavily redacted that it is not possible to discern the full context of the email – only one sentence appears and even that sentence is partially redacted. The probative value of the proffered testimony is substantially outweighed by a danger of unfair prejudice or misleading the factfinder. FRE 602 Lack of Personal Knowledge. The proffered testimony is not based on the witness’s personal knowledge of the matter and the proffering party has not introduced sufficient evidence to show the witness has personal knowledge of this matter. FRE 802 Hearsay. The proffered exhibit is an out-of-court statement that is offered to prove the truth of the matter asserted. The alleged statement by the student that is referred to in the email is hearsay-within-hearsay. FRE 1002 Secondary Evidence. The proffered testimony is offered to prove the contents of a document. FRCP 26(a) and 37 Withheld Evidence. Plaintiffs heavily redacted the proffered exhibit such that its content and context cannot properly be understood, and should not be allowed to now use it at summary judgment to suggest inferences based off what little content can be read. CONCLUSION Defendant-Counterclaimant Public.Resource.Org, Inc. respectfully requests that this Court sustain these evidentiary objections at the hearing on Plaintiffs’ Renewed Motion for Summary Judgment and for Entry of a Permanent Injunction. 95 Dated: November 8, 2019 Respectfully submitted, /s/ Andrew P. Bridges Andrew P. Bridges (admitted) abridges@fenwick.com Matthew B. Becker (admitted pro hac vice) mbecker@fenwick.com Armen N. Nercessian (pending pro hac vice) anercessian@fenwick.com Shannon E. Turner (pending pro hac vice) sturner@fenwick.com FENWICK & WEST LLP 801 California Street Mountain View, CA 94041 Telephone: (650) 988-8500 Facsimile: (650) 938-5200 Corynne McSherry (admitted pro hac vice) corynne@eff.org Mitchell L. Stoltz (D.C. Bar No. 978149) mitch@eff.org ELECTRONIC FRONTIER FOUNDATION 815 Eddy Street San Francisco, CA 94109 Telephone: (415) 436-9333 Facsimile: (415) 436-9993 David Halperin (D.C. Bar No. 426078) davidhalperindc@gmail.com 1530 P Street NW CSRL 2nd Floor Washington, DC 20005 Telephone: (202) 905-3434 Attorneys for Defendant-Counterclaimant Public Resource, Inc. 96

Disclaimer: Justia Dockets & Filings provides public litigation records from the federal appellate and district courts. These filings and docket sheets should not be considered findings of fact or liability, nor do they necessarily reflect the view of Justia.


Why Is My Information Online?