Excited to share that ExploreLLM has been accepted to
#chi2024
late breaking work with flying colors! We also hold a shiny new patent.
And I should finally clean up the code and put it on github. Stay tuned...
Introducing 🤔 Thought Experiments prompting!
⛓️Chain-of-Thought is great but real world is messier than that, especially when answering challenging moral questions.
We show self-posing and answering counterfactual questions allow LLM to improve. 1/n
personal news! after two years working on search products, I'm coming back to research
@GoogleAI
. excited to work on projects at the intersection of
#HCI
and
#AI
again. anything new while I was gone?
I'm hosting a Research intern this summer at Google 🤩. Broadly the area is dialog understanding, particularly when users make mistakes. DM for details and send your contacts my way. ❤️🙏
Hey I did it! Dr Ma now.👩🎓🎓🎉
Thanks so much to my most brilliant and supportive committee ❤️
@informor
@karen_ec_levy
@SergeBelongie
@jeffhancock
If anything, I feel humbled.
Couldn't have done it without all the mentors, collaborators, peers, friends and family. Thanks y'all!
traditional company: people spend hours doing things manually that can be automated in 20min
tech company: people spend hours automating things that can be done manually in 30min
A trend I see at
#CHI23
is HCI researchers beginning to use LLMs to create synthetic user studies. E.g.,
While it is convenient, I do worry about the potential representational harms posed by such trend -- experiences of minorities being erased.
I started working full-time a month ago post-PhD.
It's fun but I have this huge sense of loss of meaning in life (need few other tweets to unpack this feeling).
But finishing the CHI reviews today made me feel still connected to the thinking, ideas, and people.
Thank you
#chi2020
Exciting news! My team is looking for someone with human computation x ML background to work on language model safety. Apply if you are excited about cutting edge research like RLHF & care deeply about responsible AI products.
(feel free to rt and share)
Well don’t I have news for you
@pmarca
@benthompson
.
Our recent work shows moral reasoning is among the worst performing tasks for language models. I have countless examples showing how discussing moral scenarios goes horribly wrong.
I started NYC
#Computational
#Social
#Science
#Beer
Sundays with a few close phd friends. DM me if you want to join the mailing list!
We will do beer and nerdy conversations at a local spot in NYC (but mostly Brooklyn), one random Sunday (but mostly last) of the month.
hot take: remote working in the long-term will not shift power outside of silicon valley. instead, tightly-knit tech elites and vc inner circles will be even harder for someone without existing ties to enter. people are only hanging out in their backyards with strong ties.
very interesting that when one idea is shown to work, people quickly change ways of thinking and begin exploring so many other ideas. very exciting for this area of research!
Excited to share a tiny bit of what I spend my time thinking nowadays
@Google
:
Challenges in Supporting Exploratory Search through Voice Assistants
(My 1st Google paper w/ teammate Ariel Liu to Conversational User Interface workshop at
@sig_chi
.)
#hci
Hot take: can we normalize being alone? Instead of just saying "take time off and spend time with family" - add on to it "or just spending time by yourself listening to music or whatever it it that you enjoy?" Family out of this country...
When HCI students go to industry we face great confusion to pick one hat out of UX researchers, designers, data scientist, engineers, research scientists. 🤷
HCI is an interesting bridge discipline; never really accepted by CS as being a part of it, and yet never quite completely trusted by the core disciplines we bridge to… bridges are super important, but as a discipline destined to wander unanchored?
I cannot shake this fear that people are going to build AI therapists with these language models. It would at first glance look good, probably even helpful at times. But things can go wrong despite our best efforts. And someone would get hurt, spiraling into a dark place.
I am overwhelmed and warmed by the responses.
Hopefully, I can unpack this more:
I suspect the feeling of loss is primarily due to losing one giant concrete goal.
Life until now has (mostly) been a straight shot.
But going forward is much messier and less defined.
I started working full-time a month ago post-PhD.
It's fun but I have this huge sense of loss of meaning in life (need few other tweets to unpack this feeling).
But finishing the CHI reviews today made me feel still connected to the thinking, ideas, and people.
Thank you
#chi2020
I attended a Google-hosted workshop today. Workshops like these are a great chance to spread their work. I enjoyed the talks immensely.
However, for whatever reason, this was the gender breakdown. I'm posting because I think it's important that people know these statistics.
How many parameters before we can use the name VLLM (very large) and ULLM (ultra-large)?
I was an microelectronics major for undergrad and I chuckled when I learned Very-large-scale integration (VLSI) and Ultra Large-Scale Integration (ULSI).
It is giving final-final-final.pdf
Found myself in a reflective mood and wrote something about choosing between UX, data science, design, and engineering as a HCI PhD student. Hope you find yours 🎩!
mental health awareness month!
well--I guess surviving the Chinese education system; grad school; being a women; immigrant; pandemic; yada yada the odds weren't on my side.
this month I am trying to read more on mental health.
recs? already got Kandel and Sapolsky on my list
Excited to share that I'm joining the board of
@NationalSawdust
, Williamsburg's pioneering performing arts venue! 🎉 Merging two of my greatest passions:
#AI
and
#creativity
, I look forward to bringing two communities closer together.
Let me know if you want to come to a show!
What are some good ways to spend time between phd <-> full time job? (about 6 weeks).
Some goals:
- contribute to a community
- leverages skills gained from PhD (research, data, writing, mentoring)
- somewhere in Europe (Berlin maybe!)
- if possible, art + tech related
Leads <3
Ever since I was a little girl, this problem has bothered me when I prompted humans.
"Hey teacher, who should be my role models?"
It's always Bill Gates, Steve Jobs, Chairman Mao...
Very proud to contribute to mitigating this problem for LLMs. A small step! More work to do.
Large language models (LLMs) have come a long way and solve many tasks. BUT diversity and inclusion in LLM generations is still an open challenge.
📢 New
@emnlpmeeting
paper on quantifying and improving people/culture diversity in LLMs:
#EMNLP2023
1/n
When I moved to the U.S. I noticed the world map looks different from the ones I was used to in China.
In the Chinese version (left), the U.S. is squeezed to the right. In the English version, Europe is in the center (right). So I was curious to see how
#dalle
would do. 1/2
pet peeve: assumed knowledge. when i ask a question and the other person responds with the phrasing implying the answer is obvious. it doesn't show brilliance. it shows arrogance.
parents (when I was a teenager): "stop sitting in front of the computer all day. you can't do this all your life."
me (x days into wfh): "hold my beer."
In 2017 I was fascinated by Actor-Network Theory.
I viewed algorithms as increasingly important force in digitally mediated exchanges in my study of trust.
Thus born the idea and term "AI-Mediated Communication".
Excited to unveil it with
@maurice_pj
leading team
@chi2019
.
#AIMC
New paper alert, where we introduce the idea of “AI-Mediated Communication”, show how it matters in one context (Airbnb host profiles), and outline a research agenda for it. Want to learn about the Replicant Effect? Read this thread.
#chi2019
#AIMC
Advice to myself five years ago, always write your paper as "this work ..." rather than "this paper ...". The future dissertation-writing self will thank you. #⌘ + ⇧ + F
So
@taywbrown
and I wrote "AI-Mediated Exchange Theory" -a cross between human-AI interaction & sociology.
We are stoked that it has been accepted to the
Fair & Responsible AI Workshop
@sig_chi
.
Becoming a responsible adult day 1:
- change passwords for important accounts (LastPass)
- two-factor!
- setting up a personal accounting system
- eating vegetables instead of pastries for breakfast
And let's be honest I don't see how this is going to last more than a week 😂🤦
you all do realize that there is a poor computational social science phd student somewhere now / in the future trying to write a thesis on the evolution of apes in nft right?
for $9.99 you can drink a cocktail with me in a speakeasy bar in Williamsburg (aka my home) and I'll tell you all the reasons New York is better than Pittsburg
#experience
.
(cocktail included).
Student volunteers at
#CSCW2018
finally see some sunshine! Thanks for the guests who stopped by today! And I could not ask for a more amazing co-chair
@Zaga_daga
. <3
Just a reminder for product teams at various companies to consider tuning down "one year ago" feature starting now. I have a hunch that the feature won't be fun starting in March.
Next stop ->
#Google
NYC 👩💻
I will be joining
@Hillalli
and Emma Wang's team under Geo.
I hope to apply what I learned to build great products and flex my other muscles.
But hope to stay connected w/ the computational social science research community in NYC.
Nervous and excited!
So
@duncanjwatts
once said "For 20 years I thought my job was as a basic scientist. Publish papers and throw them over the wall for someone else to apply."
I'm now on the other side of the wall.
The design implication sections I've written in the past feel a little out of place.
I started working full-time a month ago post-PhD.
It's fun but I have this huge sense of loss of meaning in life (need few other tweets to unpack this feeling).
But finishing the CHI reviews today made me feel still connected to the thinking, ideas, and people.
Thank you
#chi2020
[chatting with a VC on vacation waiting for our tacos]
so what do you do
an engineer of some sort I guess
what do you work on
search
so you invent new algorithms to disrupt search?
no. I just make incremental improvements to the system
[VC unimpressed. end of convo.] oh well...
Privilege is people trusting you are capable by default, where a lot of us have to work so hard to prove it. And in the process, even risk doubting our own abilities ourselves.
When I started PhD,
@jcccf
's clean slides and presentation style inspired me a lot.
Can't believe we now worked on a talk together!!
Tomorrow 11am at Carron 2, Decision Making,
@jcccf
will present our work on trust in Facebook groups.
Lots of cool findings and graphs.
#chi2019
I kept wondering who is messing with my standing desk's preset height.
Today I finally realized it changes when I wear boots with heels v.s. sneakers🤦♀️
In 2017,
@informor
,
@jeffhancock
and myself studied what Airbnb hosts say in their profiles make them perceived trustworthy. We joked about AI making the profiles more convincing. And six years later, ChatGPT: slick tongued hospitality devil. 😈
Time confirmed for the COVID and misinformation focused CSS virtual happy hour:
**Apr 30 Thur 7pm ET / 4pm PT.**
Excited to have
@katestarbird
@natematias
@informor
and a few more on a mini-panel, followed by open discussions.
RSVP capped at 50 ppl:
NYC (virtual) Computational Social Science Happy Hour opens RSVP to everywhere in April:
A special edition on
#COVID19
and
#misinformation
. We will have
@informor
and others (if you volunteer) on a panel first, followed by open discussion.
Exact time TBD
Waking up to a nice surprise!
#CIKM2022
We present a human-ML collaboration framework for video content reviews (hint: very challenging!
#HCI
+
#AI
ftw).
Paper:
Authors: Meghana Deodhar,
@infoxiao
(myself), Yixin Cai, Alex Koes,
@alexbeutel
, Jilin Chen
Is there any tool that can generate text summaries of my availabilities based on calendar? A lot of times people ask please provide a few slots that work for you in email. It would make sense to just give access to my calendar, and generate: "free Wed 12-3pm PT; Fri 1-3pm PT"
In Chinese there is this politeness dance:
您贵姓 (what's your *distinguished* family name?)
免贵姓马(no need to be distinguished -- it's Ma)
In English when I am on the phone, people ask "who do i have the pleasure speaking with"
My Chinese-brain: "No pleasure. Just Me".
This was such a fun paper to write! There are some old-school AGI references if you could find them 🥚.
The inspiration for me came from a potential hot take: if a lot of the innovation in the space is reduced to building LLM API wrappers, why don't we make better wrappers?
Overwhelmed by endless chatbot text walls? 😵💫Can't personalize them enough? 🤔
Introducing ExploreLLM🤖! 🔥🚀 It goes Beyond Chatbots with
🧠 Structured Thoughts and
💁 Personalized Model Responses.
✨ Get ready for a new level of AI interaction! 🤩
Joint work with the…
It was fun to sit in some of the sessions
@CODEConference
on human+ai and observe how the business school folks think about these research problems vs cs or hci.
A few thoughts: 🧵
NYC (virtual) Computational Social Science Happy Hour opens RSVP to everywhere in April:
A special edition on
#COVID19
and
#misinformation
. We will have
@informor
and others (if you volunteer) on a panel first, followed by open discussion.
Exact time TBD
Stop by SV lounge (Holland II) to say hi to our wonderful student volunteers for
#CSCW2018
. Special shout-out to Fannie Liu () at
@cmuhcii
who designed the (IMHO) the best SV-shirt ever (omg it's black <3).
#cscw2018
#sv
#studentvolunteer
In 2017, I founded the WiTNY Ambient Belonging Project.
We source visual designs from
@cornell_tech
&
@CUNY
that highlight diversity; and install them on campus to encourage an ambient sense of belonging.
This year
@MANIfication
led our 3rd installation.
Winning designs (thread):
Are you among the influx of <hip> data science summer interns in NYC?
Come join our NYC Computational Social Science happy hour this **Thursday, June 6th, 6pm**. In Manhattan for the first time!
(Def an experimental setup to measure showup rates, especially UWS Columbia ppl.)
NYC mark your calendars!
@infoxiao
@george_berry
& I are hosting June's Computational Social Science Happy Hour on Thurs, 06/06 @ 06p. Theme: "horror stories in data cleaning" ... so come ready to regale ; )
We're gonna be in Manhattan this time!
Congratulations!!!
*AI-Mediated Interactions* are where my dissertation arrived at but never really fully flushed out. This AI-MC paper sets a really solid theoretical foundation for exciting research directions.
I encourage all AI/HCI researchers and practitioners to read.
*NEW PAPER* in which
@jeffhancock
@karen_ec_levy
& I introduce AI-MC: AI's increasingly central role in human communication (from smart replies to deep fakes) and how this trend may impact our language *and* our interpersonal relations, including how we trust each other 1/
Thoughtful keynote by
@syardi
on "What's missing when we rely on social media log data." Engagement (attention) and activity (clicks, likes, and comments) do not necessarily align.
#ICWSM
#icwsm2018
My own spin inspired by Crying in H Mart. A public ranked test seats arrangement mechanism in my Chinese high school still haunts me to this day --
Trapped in the First Test Room