How Representative is the Bearometer?

Metadata
Title: How Representative is the Bearometer?
Category: undergraduate
UUID: 0f6a1bd04d244a52a5c079826f9ebe41
Source URL: https://bearometer.berkeley.edu/2025/10/31/how-representative-is-the-bearometer/
Parent URL: https://bearometer.berkeley.edu/
Crawl Time: 2026-03-10T04:07:22+00:00
# How Representative is the Bearometer?

**Source**: https://bearometer.berkeley.edu/2025/10/31/how-representative-is-the-bearometer/
**Parent**: https://bearometer.berkeley.edu/

Written by

[bearometerkeeper](https://bearometer.berkeley.edu/author/bearometer/)

in

[Bearometer](https://bearometer.berkeley.edu/category/bearometer/)

The Bearometer is an independent faculty project that poses a single poll question to Berkeley Senate faculty on issues of teaching and governance. It is unaffiliated with the Academic Senate or the administration and is modeled on MIT’s Faculty Pulse. Faculty propose and vote on questions, which are then selected by the Question Keepers (currently Chris Hoofnagle, Law; and William Fithian, Statistics) for distribution via university email. The Bearometer emphasizes anonymity to protect candid participation and typically receives responses from about 200 faculty per poll, providing rapid, faculty-driven feedback between formal Senate surveys. The Bearometer has run a dozen iterations on topics such as academic freedom, student preparedness, and faculty governance.

The Bearometer emphasizes anonymity to protect faculty speech, though this limits demographic representativeness.

Faculty speech is strongly protected by academic freedom, yet academics have many incentives to keep their views closely held. Thus, the Bearometer has both technological and procedural methods to ensure that any participant will not be identified. Anonymity is a fundamental feature of the Bearometer.

This anonymity leads to a problem: is the Bearometer valid? Or are its participants basically the same people every time?

On internal validity: we are confident that only Berkeley faculty are completing the Bearometer because we have an authoritative list of senate members, and because we distribute to email with unique links. We receive Qualtrics reports on possible fraud (typically someone has submitted twice) and these reports signal that double dipping is quite rare—typically just 1 or 2 submissions.

The unknown problem is representativeness: is the Bearometer a valid measurement of the faculty itself?

To answer this question, we examined response patterns from Bearometers 5-12 (the last 8 surveys, as we deleted earlier data consistent with privacy protections), focusing on our regular faculty (non-emerita).

In sum, this is what we found: Across eight surveys, 52% of regular faculty never participated. Of those that did, 60% have just done 1 or 2. Only 13% have done 5 or more.

## Bearometer Participants

| # of Completed Bearometers | Faculty Count | Total Percent |
| --- | --- | --- |
| 0 | 819 | 52.3% |
| 1 | 290 | 18.5% |
| 2 | 159 | 10.2% |
| 3 | 119 | 7.6% |
| 4 | 77 | 4.9% |
| 5 | 49 | 3.1% |
| 6 | 27 | 1.7% |
| 7 | 15 | 1.0% |
| 8 | 11 | 0.7% |

This table presents whether and how many times faculty have completed a Bearometer. It is based on Bearometers 5-12 (8 total). Note 52% have never done a Bearometer. On the other hand, very few have completed more than 5. 

As one can see, most regular faculty haven’t done Bearometers 5-12 (we no longer have data for Bearometers 1-4). Of those that do, the Bearometer is not dominated by any small faction. Only 11 people have done all 8. 15 have done 7. 27 did 6.

Some of these Bearometers were quite popular. We have an overall 14.6% response rate from regular faculty based on Bearometers 5-12.

| Bearometer | N |
| --- | --- |
| Bearometer 12: Attendance | 180 |
| Bearometer 11: Best of Berkeley | 138 |
| Bearometer 10: Student Evaluations of Teaching | 238 |
| Bearometer 9: Student Preparation | 238 |
| Bearometer 8: Getting Reimbursed | 237 |
| Bearometer 7: External Criticisms | 291 |
| Bearometer 6: Chancellor Vision | 155 |
| Bearometer 5: Free Speech Temperature | 335 |
| Bearometer 4: Intercollegiate Athletics | 341 |
| Bearometer 3: SAT/ACT Testing | 430 |
| Bearometer 2: Union | 179 |
| Bearometer 1: Welfare | 300 |

We also studied STEM versus non-STEM participation.

## STEM and Non-STEM Participation

| # of Completed Bearometers | Non-STEM | STEM |
| --- | --- | --- |
| 0 | 375 | 444 |
| 1 | 151 | 139 |
| 2 | 77 | 82 |
| 3 | 62 | 57 |
| 4 | 39 | 38 |
| 5 | 27 | 22 |
| 6 | 9 | 18 |
| 7 | 7 | 8 |
| 8 | 3 | 8 |
| Total | 750 | 816 |

This table presents participation broken out by STEM status. Regular (non-emerita) faculty only.

Berkeley has more STEM faculty (based on primary appointment). The different in participation between the groups is not significant.

Mean response rate, STEM versus Non-STEM regular faculty.

There are no statistically significant differences across departments.

Mean response rate by department category, regular faculty only.

Few emerita participate in the Bearometer. Of the 1,016 in our distribution list, 824 have never completed a Bearometer. 100 have completed 1. Another 92 have completed more than 1.

Emerita faculty rarely participate. Over 8 Bearometers, only 192 have ever participated. Nonetheless, we poll emerita because they are senate members and have a career of experiences to share with us.

What we do not know: we do not have data on sex, nor on pre/post tenure. Both of these variables, especially combined with departments, could undermine the anonymity of the Bearometer. But we also know that less powerful faculty may have the strongest speech concerns. Perhaps one might think that more senior faculty attitudes predominate, however, the Bearometer’s anonymity operates to protect these classes of faculty where other alternatives, such as the climate surveys, cannot because of climate surveys’ intense focus on demographics and combinatorial options.

The Bearometer has tradeoffs. It can rapidly and reliably get feedback from about 200 regular faculty in just days, using a single email invitation. Campus climate surveys can get higher participation, but only after weeks of recruitment, and these surveys come years apart (2009, 2011, 2019). In addition, the Bearometer is more democratic: the questions come from faculty members themselves. This helps give signals to decision makers free of the kinds of restraints on the senate and faculty administrators.

## More posts

- ### [Bearometer 18: Senior Administrators](https://bearometer.berkeley.edu/2026/03/03/faculty-bearometer-18-senior-administrators/)

  [March 3, 2026](https://bearometer.berkeley.edu/2026/03/03/faculty-bearometer-18-senior-administrators/)
- ### [Bearometer 17: Grade Policy](https://bearometer.berkeley.edu/2026/02/21/bearometer-17-grade-policy/)

  [February 21, 2026](https://bearometer.berkeley.edu/2026/02/21/bearometer-17-grade-policy/)
- ### [Bearometer 16: Compliance](https://bearometer.berkeley.edu/2026/01/31/bearometer-16-compliance/)

  [January 31, 2026](https://bearometer.berkeley.edu/2026/01/31/bearometer-16-compliance/)
- ### [First Annual Beary Awards](https://bearometer.berkeley.edu/2025/12/22/first-annual-beary-awards/)

  [December 22, 2025](https://bearometer.berkeley.edu/2025/12/22/first-annual-beary-awards/)
- ### [Bearometer 15: Open Discussion](https://bearometer.berkeley.edu/2025/11/19/bearometer-15-open-discussion/)

  [November 19, 2025](https://bearometer.berkeley.edu/2025/11/19/bearometer-15-open-discussion/)
- ### [Bearometer 14: AI](https://bearometer.berkeley.edu/2025/11/11/bearometer-14-ai/)

  [November 11, 2025](https://bearometer.berkeley.edu/2025/11/11/bearometer-14-ai/)
- ### [How Representative is the Bearometer?](https://bearometer.berkeley.edu/2025/10/31/how-representative-is-the-bearometer/)

  [October 31, 2025](https://bearometer.berkeley.edu/2025/10/31/how-representative-is-the-bearometer/)
- ### [Bearometer 13: Disability Accommodation](https://bearometer.berkeley.edu/2025/10/28/bearometer-13-disability-accommodation/)

  [October 28, 2025](https://bearometer.berkeley.edu/2025/10/28/bearometer-13-disability-accommodation/)
- ### [Bearometer 12: Attendance](https://bearometer.berkeley.edu/2025/10/14/bearometer-12-attendance/)

  [October 14, 2025](https://bearometer.berkeley.edu/2025/10/14/bearometer-12-attendance/)
- ### [Bearometer 11: Best of Berkeley](https://bearometer.berkeley.edu/2025/10/07/bearometer-11-best-of-berkeley/)

  [October 7, 2025](https://bearometer.berkeley.edu/2025/10/07/bearometer-11-best-of-berkeley/)
- ### [Bearometer 10: Student Evaluations of Teaching](https://bearometer.berkeley.edu/2025/09/24/bearometer-10-student-evaluations-of-teaching/)

  [September 24, 2025](https://bearometer.berkeley.edu/2025/09/24/bearometer-10-student-evaluations-of-teaching/)
- ### [Bearometer Methods Fall 2025](https://bearometer.berkeley.edu/2025/09/06/bearometer-methods-fall-2025/)

  [September 6, 2025](https://bearometer.berkeley.edu/2025/09/06/bearometer-methods-fall-2025/)
- ### [Bearometer 9: Student Preparation](https://bearometer.berkeley.edu/2025/05/03/bearometer-9-student-preparation/)

  [May 3, 2025](https://bearometer.berkeley.edu/2025/05/03/bearometer-9-student-preparation/)
- ### [Bearometer 8: Getting Reimbursed](https://bearometer.berkeley.edu/2025/04/22/bearometer-8-getting-reimbursed/)

  [April 22, 2025](https://bearometer.berkeley.edu/2025/04/22/bearometer-8-getting-reimbursed/)
- ### [Bearometer 7: External Criticisms](https://bearometer.berkeley.edu/2025/04/17/bearometer-7-external-criticisms/)

  [April 17, 2025](https://bearometer.berkeley.edu/2025/04/17/bearometer-7-external-criticisms/)
- ### [Bearometer 6: Chancellor Vision](https://bearometer.berkeley.edu/2025/04/08/bearometer-6-chancellor-vision/)

  [April 8, 2025](https://bearometer.berkeley.edu/2025/04/08/bearometer-6-chancellor-vision/)
- ### [Bearometer 5: Free Speech Temperature](https://bearometer.berkeley.edu/2025/04/02/bearometer-5-free-speech-temperature/)

  [April 2, 2025](https://bearometer.berkeley.edu/2025/04/02/bearometer-5-free-speech-temperature/)
- ### [Bearometer 4: Intercollegiate Athletics](https://bearometer.berkeley.edu/2025/03/04/bearometer-4-intercollegiate-athletics/)

  [March 4, 2025](https://bearometer.berkeley.edu/2025/03/04/bearometer-4-intercollegiate-athletics/)
- ### [Bearometer 3: SAT/ACT Testing](https://bearometer.berkeley.edu/2025/02/20/bearometer-3-sat-act-testing/)

  [February 20, 2025](https://bearometer.berkeley.edu/2025/02/20/bearometer-3-sat-act-testing/)
- ### [Bearometer 2: Union](https://bearometer.berkeley.edu/2025/02/14/bearometer-2-union/)

  [February 14, 2025](https://bearometer.berkeley.edu/2025/02/14/bearometer-2-union/)
- ### [Bearometer 1: Welfare](https://bearometer.berkeley.edu/2025/01/25/bearometer-1-welfare/)

  [January 25, 2025](https://bearometer.berkeley.edu/2025/01/25/bearometer-1-welfare/)