A color picture with a photo of a woman on the left and a man on the right

By Patricia Waldron

It’s time for end-of-the-year “best of” lists, and two faculty members affiliated with the Cornell Ann S. Bowers College of Computing and Information Science made this year’s list for Forbes 30 under 30: Science.

Allison Koenecke, assistant professor of information science, and Nikhil Garg, assistant professor at ORIE and the Jacobs Technion-Cornell Institute at Cornell Tech, and a field member in computer science and information science, both made the cut.

Forbes selected Koenecke for her research on fairness in algorithmic systems. Her work has uncovered racial disparities in speech recognition systems – such as the kind used in virtual assistants – showing that despite recent advances, the technology still underperforms for Black users. Additionally, in an analysis of online ads promoting California's Supplemental Nutrition Assistance Program, Koenecke showed that disparities in ad targeting algorithms resulted in fewer Spanish speakers signing up.

Nikhil Garg made the list for his work on designing more equitable economic and social systems. He uses algorithms, machine learning, and data science to better understand a range of issues, including gerrymandering, surge pricing in ride-hailing, and polarization on Twitter. Garg’s recent research studies and addresses disparities in crowdsourcing and government service allocation, including in New York City and Chicago.

Koenecke and Garg are also friends and co-authors, having worked together on a paper studying how people make errors when interpreting images

Patricia Waldron is a writer for the Cornell Ann S. Bowers College of Computing and Information Science.

 

Date Posted: 12/12/2022
A color photo of a man wearing a sweater

Matthew Law is a doctoral candidate in information science from Moorestown, New Jersey. He earned a B.A. in philosophy at Georgetown University and a B.S. in computer science from the University of Maryland Baltimore County and now studies how robots can help humans make creative decisions at Cornell under the guidance of Guy Hoffman.

What is your area of research and why is it important?

I study how robots can help humans make creative decisions when designing. Our robots use physical materials, like wooden blocks or paper notecards, to communicate ideas with human users. For example, one of our robots works with humans to organize ideas written on notecards into thematic clusters. Robots can employ scalable computational methods that complement human experience and intuition for design problems. For example, a robot might search for and evaluate many alternatives to a human’s initial design. Since humans frequently think with their hands, interacting with robots through familiar materials offers an accessible interface to these benefits.

What are the larger implications of this research?

Human-robot collaboration is commonly used for physical tasks like fabrication or surgery. My research seeks to extend this knowledge to support cognitive and design activities. Many everyday problems involve complex design choices–for example, planning a class schedule involves managing constraints, balancing requirements and personal goals, and making decisions on partial information. I believe that affordable, desktop-scale robots offer a completely new way to think about supporting design activities with technology, building on existing and familiar material practices, like affinity-diagramming, to help people reflect on their choices, consider alternate opinions, resolve areas of uncertainty, and document their work.

Why did you decide to become a mentor with the MAC Mentoring Program? 

I learned a lot of things as a Ph.D. student through trial and error and wanted to use my experiences to help others navigate challenges that I’ve learned are quite common among students, like dealing with imposter syndrome, making the most out of your relationship with your advisor, or choosing a research question. I also wanted to grow myself as a mentor and learn more about different academic cultures and experiences. Students in the MAC mentoring community span academic disciplines and the breadth of their experiences has really expanded my perspective on mentorship and academic life.

Why is it important for students to participate in peer mentoring programs?

Relationships are an important part of academic life and doing a Ph.D. can sometimes feel quite solitary. Participating in peer mentorship programs is a great, low-risk way to find and build support networks that offer community and resources. There are also a lot of hidden curricula in navigating a research career, and peer mentorship is one way that students can work together to help each other overcome this. Finally, serving as a mentor is a great way to learn about and develop effective mentorship practices and philosophies.

What are your hobbies or interests outside of your research or scholarship?

I have been slowly learning how to draw cartoons and have been incorporating this into how I teach and communicate my work. I also have four cats and like to play tennis badly with my wife. 

Why did you choose Cornell to pursue your degree?

I was really attracted by the unique way that Cornell’s field of information science values creative and human-centered work. Our field has a genuine commitment to understanding the human side of technology through multiple, cross-disciplinary lenses. This provides the opportunity and resources to pursue ideas in creative and multi-faceted ways.

Date Posted: 12/09/2022
A color photo of a woman smiling for a photo

Allison Koenecke, Information Science 

Dialectal Fairness in Korean Speech-to-Text Technology 

Using a Korean corpus of five regional dialects plus “standard” Korean speech, we address the problem of speech-to-text fairness in commercial technology. Will non-standard dialects have worse error rates, and what are the drivers and remedies for disparities? Comprehensive linguistic analysis of Korean dialects follows.

Date Posted: 12/09/2022
A color picture of a book cover with the text "Data Driven," a truck silhouette, and eyes watching

By Tom Fleischman, Cornell Chronicle

For many truckers, driving is more than just a job.

“The occupational identity of the trucker is really strong,” said Karen Levy, associate professor of information science in the Cornell Ann S. Bowers College of Computing and Information Science.

“They really see themselves as ‘truckers,’ not just as people who drive trucks,” Levy said. “There’s a whole culture associated with it, and a lot of pride and professionalism.”

Picture a truck driver, and a few images probably pop into your head. First, the trucker is likely male – which isn’t surprising, since more than 90% of all U.S. truck drivers are men. You might envision this driver mustachioed or bearded, wearing a cap adorned with a U.S. flag or some other symbol of American might.

You might even picture Cledus Snow and his dog, Fred, from 1977’s “Smokey and the Bandit,” or arm-wrestling Lincoln Hawk in 1987’s “Over the Top.”

Yes, the images are all cliché – but they didn’t get to be clichés by being totally untrue.

Much of trucking culture is about the independence associated with it – just the driver and his rig on the open road. But a proliferation a technology known as the electronic logging device, or ELD, aimed at tracking truckers’ every movement, and non-movement, has invaded truckers’ inner sanctum.

Levy, who started research on truck drivers as a graduate student, is the author of “Data Driven: Truckers, Technology, and the New Workplace Surveillance,” which examines how truckers’ work is being affected by a proliferation of technology ostensibly developed to promote driver safety. Drivers, Levy said, tend to disagree.

Levy spoke with the Chronicle about her new book.

Question: Where did your fascination for the trucking industry and the work lives of truckers begin?

Answer: I started researching truck drivers while studying the sociology of law and technology. I was really interested in what it looks like to enforce laws using technology. One day I randomly heard a story on the radio about how truckers were upset about a proposed rule that would require them to install monitoring devices in their cabs in order to keep track of the hours they work. I didn’t know anything about truckers, but that day I went to a truck stop just to see what it was like to talk to drivers. And I was hooked right away; truckers had such interesting stories to tell, and were so generous with their time and expertise.

Q: You spoke to dozens of truckers and others related to the industry. What is the general sense of electronic surveillance and its usefulness in terms of keeping drivers and others on the road safe?

A: Very consistently, truckers describe electronic monitoring as making them feel like criminals or like children. Digital surveillance flies in the face of truckers’ sense of professionalism – it seems premised on the idea that they aren’t to be trusted. Some of the technologies are really quite invasive, monitoring things like a driver’s eyelids or his brainwaves to see how tired he is. And maybe we could stomach some of this if there was really a demonstrable impact on safety. But we don’t even have evidence that safety has increased. In fact, the data we have show that truck crash rates have gone up since ELDs were made mandatory.

Q: Did your opinion of ELDs and their utility change over the course of researching this book?

A: I think one of the things that became really clear for me over time is that if there are negative implications of a new technology, like ELDs, the answer isn’t necessarily just to go back to the status quo. That’s often where the conversation goes – that the “old way” of doing something was better. But in trucking, the status quo has been pretty terrible economically for workers. So I think the key is not to say, “Let’s just undo the technology,” and have that be the endpoint of the analysis. I think the key is to say, “Well, the technology is a clue that there’s a bigger social or economic problem. What should be done about that?

Q: Why is simply throwing technology at a problem that is non-technological (overworked, underpaid truckers) a bad thing?

A: Often, when we use technology to try to solve a problem, what is actually happening is that we are using technology to avoid solving a different, bigger problem. In trucking, there are huge problems with truckers not being paid for their work. Truckers are exempt from the Fair Labor Standards Act, which guarantees overtime pay to most workers. And they’re generally paid by the mile, which means that they make no money at all for all the time they spend waiting to be loaded or unloaded at terminals, or doing inspections, or sitting in traffic. That routinely adds up to several hours a day of unpaid work. So because of this, it’s not surprising that truckers are incentivized to drive as much as they can, even when they’re tired—it’s the only way they can make money! And monitoring them really doesn’t change or challenge these root causes of overwork. If we really want to prevent truckers from driving while tired, what we need is economic reform to address the root causes.

Do you foresee a time when ELDs will no longer be required? Or are they working from an industry perspective?

A: That depends what we mean by “working.” Are they making the roads safer for the public? The evidence doesn’t suggest that they are. Are they giving managers more oversight? Absolutely. Are they generating value for third-party companies that want to sell stuff, like parking spaces, to truckers? Also yes. In the book, I talk about how the biggest impact of the government mandate of ELDs is that it scaffolds a bunch of additional surveillance by private firms – it’s all interoperable, because the technology bundles it all together. So for this reason, I think ELDs are very likely to stick around, whether or not they accomplish their stated goal.

Date Posted: 12/06/2022
A color photo of 2 men with a red background

“Given a snapshot of a social network, can we infer which new interactions among its members are likely to occur in the near future?”  

Thus asks the 2003 paper and recent Test of Time Award-winning research from Jon Kleinberg, the Tisch University Professor of Computer Science in the Cornell Ann S. Bowers College of Computing and Information Science, and David Liben-Nowell ’99, currently a professor of computer science and associate provost at Carleton College. 

The duo’s paper, "The link prediction problem for social networks," was recognized at the ACM International Conference on Information and Knowledge Management, which was held in October. Since its publication nearly 20 years ago, the paper has proved foundational in informing early work that developed link recommendation algorithms for social media platforms including Facebook and Twitter. 

It’s also cited in some of the initial papers laying the foundations for modern graph neural networks and was an early paper to use publishing and co-authoring data from arxiv.org for network research. 

Date Posted: 11/29/2022
A color photo of a woman using a virtual reality headset, with a man assisting

Distributed teams, with members who work remotely or across vast distances, often rely on virtual, software-supported workspaces that try to recreate the kinds of interactions that occur in face-to-face meetings. This approach, which underlies traditional email and text chat, video conferencing, and various virtual and mixed-reality tools, cannot address certain critical challenges faced by virtual, distributed teams—particularly mismatches in social conventions, work styles, and conversational norms. Such differences can create misunderstandings, harm relationships among team members, and reduce team performance.

An interdisciplinary team of Cornell researchers is creating virtual environments to promote more effective communication in distributed teams. Specifically, this project will 1) develop a basic understanding of how differences in individual communication styles and conversational norms influence people’s nonverbal behaviors and their interpretation of others’ behaviors in face-to-face and virtual settings; 2) develop a system that modulates a user’s verbal and nonverbal behavior in virtual reality to help team members accommodate each other’s norms; and 3) investigate how users prefer to use such tools to manage their self-presentation and how they prefer to receive feedback from teammates.

This research seeks to improve remote interactions and the performance of distributed teams. By making virtual teamwork easier and more effective, this research could reduce work-related travel and its environmental impacts. Researchers will develop guidelines on representing behavior to improve collaboration and techniques for transforming behavior while preserving individual autonomy. The tools developed by this research could also set the stage for more effective interactions when distributed teams meet in person.

Cornell Researchers

Andrea Stevenson Won
Communication, College of Agriculture and Life Sciences


Susan R. Fussell
Communication, College of Agriculture and Life Sciences/Information Science, Computing and Information Science


Malte F. Jung
Information Science, Cornell Ann S. Bowers College of Computing and Information Science

Funding Received

$1.2 Million spanning 4 years

Sponsored by The National Science Foundation

Date Posted: 11/29/2022
A graphic with source code over a hand using a stylus on a tablet.

By Louis DiPietro

A Cornell team has created an interface that allows users to handwrite and sketch within computer code – a challenge to conventional coding, which typically relies on typing.

The pen-based interface, called Notate, lets users of computational, digital notebooks – such as Jupyter notebooks, which are web-based and interactive – to open drawing canvases and handwrite diagrams within lines of traditional, digitized computer code.

Powered by a deep learning model, the interface bridges handwritten and textual programming contexts: Notation in the handwritten diagram can reference textual code and vice versa. For instance, Notate recognizes handwritten programming symbols, like “n,” and then links them up to their typewritten equivalents. In a case study, users drew quantum circuit diagrams inside of Jupyter notebook code cells.

The tool was described in “Notational Programming for Notebook Environments: A Case Study with Quantum Circuits,” presented at the ACM Symposium on User Interface Software and Technology, held Oct. 29 through Nov. 2 in Bend, Oregon. The paper, whose lead author is Ian Arawjo, doctoral student in the field of information science, won an honorable mention at the conference.

“A system like this would be great for data science, specifically with sketching plots and charts that then inter-operate with textual code,” Arawjo said. “Our work shows that the current infrastructure of programming is actually holding us back. People are ready for this type of feature, but developers of interfaces for typing code need to take note of this and support images and graphical interfaces inside code.”

Arawjo said the work demonstrates a new path forward by introducing artificial intelligence-powered, pen-based coding at a time when drawing tablets are becoming more widely used.

“Tools like Notate are important because they open us up to new ways to think about what programming is, and how different tools and representational practices can change that perspective,” said Tapan Parikh, associate professor of information science at Cornell Tech and a paper co-author.

Other co-authors are: Anthony DeArmas ’22; Michael Roberts, a doctoral student in the field of computer science; and Shrutarshi Basu, Ph.D. ’18, currently a visiting assistant professor of computer science at Middlebury College.

Louis DiPietro is a writer for the Cornell Ann S. Bowers College of Computing and Information Science.

Date Posted: 11/28/2022
A color photo of four Cornell students

By Patricia Waldron 

The Cornell Ann S. Bowers College of Computing and Information Science rolled out the red carpet at its New Majors Welcome Event, a celebration to embrace newly declared students and showcase the breadth of opportunities, activities, and services now available to them.

More than 200 students attended the event held Oct. 27 in the Statler Auditorium. Attendees received a warm welcome from Kavita Bala, dean of the college, and introductions to LeeAnn Roberts, director for the Cornell Bowers CIS’ Office of Diversity, Equity, and Inclusion, and Ingrid Jensen, director of Student Services. A faculty panel offered advice to the new majors, and leaders from student groups promoted their organizations.

Cornell Bowers CIS majors receive admittance to the university through Cornell Engineering, the College of Agriculture and Life Sciences, or the College of Arts and Sciences. But once they declare a major in biometry and statistics, information science, computer science, statistical science, or information science, systems, and technology, they have access to a variety of exciting courses, clubs, professional development activities, and resources through the college.

 “It is an incredibly exciting time to be in this field,” said Bala in her opening remarks. “Whatever you learn over the next few years, we really hope that you will take it and have an impact on future technologies.”

A color photo of a woman speaking in an auditorium

During the faculty panel, David Williamson, chair of the Department of Information Science and professor of operations research and information engineering, summed up his advice in four words: “Show up, get help.”

“You'd be surprised how much you learn when you actually show up to lectures,” Williamson joked. He also urged students to take advantage of the many resources available on campus. These include faculty and course staff office hours, Cornell Bowers CIS’ Office of Diversity, Equity, and Inclusion, one-on-one advising appointments with Cornell Bowers CIS Student Services staff advisors, and the university mental health resources.

Eva Tardos, the Jacob Gould Schurman Professor of Computer Science and department chair, advised students to find a community that supports them. “Having your community, where you’re engaged and you’re active, I think makes your life a lot better,” she said.

Faculty also discussed the numerous opportunities for student research available within the college. “When you get involved in undergraduate research, you can be creative, and you can own that topic,” said Martin Wells, the Charles A. Alexander Professor of Statistical Sciences and chair of the Department of Statistics and Data Science. “It really puts all the coursework that you're taking together.”

The many opportunities to do research is what attracted Devisree Tallapaneni ’24, a double major in physics and statistics who attended the welcome event. “I'm really interested in the field of astrostatistics, which is a very niche and interdisciplinary area,” she said. Tallapeneni is already involved in astronomy research but is also interested in research in statistics. She plans to go on to graduate school after graduation.  

The event wrapped up with presentations from student groups, including the Association of Computer Science Undergraduates (ACSU), the Information Science Students Association (ISSA), and the Underrepresented Minorities in Computing (URMC). Along with Women in Computing at Cornell (WICC), who were unable to attend, these groups offer mentoring, professional development, networking opportunities, and social activities for students in the college.

A color photo of 4 people talking to a crowd

Beyond these groups, there are many other opportunities to be involved in the college. Students can join CornellAppDev – a group that develops apps that benefit the local community, become a teaching assistant, participate in a hackathon, or apply for DEI programs, like the SoNIC Summer Research Institute or the Social Impact Summer School.

With all of these options, it can almost feel like too much of a good thing, Bala said.

“There are many opportunities – it may be a bit overwhelming,” she said. “Don't get overwhelmed, get excited about it. Reach out to the Student Services group and they can help you navigate all of it.”

Patricia Waldron is a writer for the Cornell Ann S. Bowers College of Computing and Information Science.


Date Posted: 11/17/2022
A color photo of hands using a laptop computer

Personal sensing data could help monitor and alleviate stress among resident physicians, although privacy concerns over who sees the information and for what purposes must be addressed, according to collaborative research from Cornell Tech.

Burnout in all types of workplaces is on the rise in the U.S., where the “Great Resignation” and “silent quitting” have entered the lexicon in recent years. This is especially true in the health care industry, which has been strained beyond measure due to the COVID-19 pandemic.

Stress is physical as well as mental, and evidence of stress can be measured through the use of smartphones, wearables and personal computers. But data collection and analysis – and the larger questions of who should have access to that information, and for what purpose – raise myriad sociotechnical questions.

“We’ve looked at whether we can measure stress in workplaces using these types of devices, but do these individuals actually want this kind of system? That was the motivation for us to talk to those actual workers,” said Daniel Adler, co-lead author with fellow doctoral student Emily Tseng of “Burnout and the Quantified Workplace: Tensions Around Personal Sensing Interventions for Stress in Resident Physicians,” published Nov. 11 Proceedings of the ACM on Human-Computer Interaction.

The paper is being presented at the ACM Conference on Computer-Supported Cooperative Work (CSCW) and Social Computing, taking place virtually Nov. 8-22.

Adler and Tseng worked with senior author Tanzeem Choudhury, the Roger and Joelle Burnell Professor in Integrated Health and Technology at the Jacobs Technion-Cornell Institute at Cornell Tech. Contributors came from Zucker School of Medicine at Hofstra/Northwell Health and Zucker Hillside Hospital.

The resident physician’s work environment is a bit different from the traditional apprenticeship situation in that their supervisor, the attending physician, is also their mentor. That can blur the lines between the two.

“That’s a new context,” Tseng said. “We don’t really know what the actual boundaries are there, or what it looks like when you introduce these new technologies, either. So you need to try and decide what those norms might be to determine whether this information flow is appropriate in the first place.”

Choudhury and her group addressed these issues through a study involving resident physicians at an urban hospital in New York City. After hourlong interviews with residents on Zoom, the residents and their attendings were given mockups of a Resident Wellbeing Tracker, a dashboard with behavioral data on residents’ sleep, activity and time working; self-reported data on residents’ levels of burnout; and a text box where residents could characterize their well-being.

Tseng said the residents were open to the idea of using technology to enhance well-being. “They were also very interested in the privacy question,” she said, “and how we could use technologies like this to achieve those positive ends while still balancing privacy concerns.”

The study featured two intersecting use cases: self-reflection, in which the residents view their behavioral data, and data sharing, in which the same information is shared with their attendings and program directors for purposes of intervention.

Among the key findings: Residents were hesitant to share their data without the assurance that supervisors would use it to enhance their well-being. There is also a question of anonymity, which was more likely with more participation. But greater participation would hurt the potential usefulness of the program, since supervisors would not be able to identify which residents were struggling.

“This process of sharing personal data is somewhat complicated,” Adler said. “There is a lot of interesting continuing work that we’re involved in that looks at this question of privacy, and how you present yourself through your data in more-traditional mental health care settings. It’s not as simple as, ‘They’re my doctor, therefore I’m comfortable sharing this data.’”

The authors conclude by referring to the “urgent need for further work establishing new norms around data-driven workplace well-being management solutions that better center workers’ needs, and provide protections for the workers they intend to support.”

Other contributors included Emanuel Moss, a postdoctoral researcher at Cornell Tech; David Mohr, a professor in the Feinberg School of Medicine at Northwestern University; as well as Dr. John Kane, Dr. John Young and Dr. Khatiya Moon from Zucker Hillside Hospital.

The research was supported by grants from the National Institute of Mental Health, the National Science Foundation and the Digital Life Initiative at Cornell Tech.

By Tom Fleischman, Cornell Chronicle

Date Posted: 11/17/2022
Artwork from artist Marc Liu, information science undergraduate student

Survival Mechanism, a new art exhibit from an information science undergraduate student, is currently on display at the Experimental Gallery in Cornell University’s Tjaden Hall. 

Marc Liu '23 is the artist behind the work, which is described as “a loose bundle of questions about space.” 

“The works represent attempts at filling a space, measuring it, feeling it, and moving within it and in between. Why?” Liu wrote in the show description. “Perhaps these past seven years as an international student — living in a place with an expiration date, spreading myself thin between continents — have ingrained in me a spatial instinct. Space as a survival mechanism: knowing it and navigating it so that I might settle and find respite, for however brief a period.” 

The show will run through Friday, Nov. 11, with an opening reception from 5 to 7 p.m. on Wednesday, Nov. 9, in the Experimental Gallery. The gallery is open 8 a.m. to 4:30 p.m. weekdays.

 

Date Posted: 11/09/2022

Pages