THESE HIDDEN WOMEN HELPED INVENT CHAOS THEORY

Imatge
Àmbits Temàtics

Origi­nal post here

A LITTLE OVER half a century ago, chaos star­ted spilling out of a famous expe­ri­ment. It came not from a petri dish, a beaker or an astro­no­mi­cal obser­va­tory, but from the vacuum tubes and diodes of a Royal McBee LGP-30. This “desk” compu­ter—it was the size of a desk—­weig­hed some 800 pounds and soun­ded like a passing prope­ller plane. It was so loud that it even got its own office on the fifth floor in Buil­ding 24, a drab struc­ture near the center of the Massa­chu­setts Insti­tute of Tech­no­logy. Instruc­ti­ons for the compu­ter came from down the hall, from the office of a mete­o­ro­lo­gist named Edward Norton Lorenz.

QUANTA MAGA­ZINE

author photo

ABOUT

Origi­nal story reprin­ted with permis­sion from Quanta Maga­zine, an edito­ri­ally inde­pen­dent publi­ca­tion of the Simons Foun­da­tion whose mission is to enhance public unders­tan­ding of science by cove­ring rese­arch deve­lop­ments and trends in mathe­ma­tics and the physi­cal and life scien­ces.

The story of chaos is usually told like this: Using the LGP-30, Lorenz made para­digm-wrec­king disco­ve­ries. In 1961, having program­med a set of equa­ti­ons into the compu­ter that would simu­late future weat­her, he found that tiny diffe­ren­ces in star­ting values could lead to dras­ti­cally diffe­rent outco­mes. This sensi­ti­vity to initial condi­ti­ons, later popu­la­ri­zed as the butterfly effect, made predic­ting the far future a fool’s errand. But Lorenz also found that these unpre­dic­ta­ble outco­mes weren’t quite random, either. When visu­a­li­zed in a certain way, they seemed to prowl around a shape called a strange attrac­tor.

About a decade later, chaos theory star­ted to catch on in scien­ti­fic circles. Scien­tists soon encoun­te­red other unpre­dic­ta­ble natu­ral systems that looked random even though they weren’t: the rings of Saturn, blooms of marine algae, Earth’s magne­tic field, the number of salmon in a fishery. Then chaos went mains­tream with the publi­ca­tion of James Gleick’s Chaos: Making a New Sciencein 1987. Before long, Jeff Gold­blum, playing the chaos theo­rist Ian Malcolm, was pausing, stam­me­ring and char­ming his way through lines about the unpre­dic­ta­bi­lity of nature in Juras­sic Park.

All told, it’s a neat narra­tive. Lorenz, “the father of chaos, ” star­ted a scien­ti­fic revo­lu­tion on the LGP-30. It is quite lite­rally a text­book case for how the nume­ri­cal expe­ri­ments that modern science has come to rely on—in fields ranging from climate science to ecology to astrophy­sics—­can unco­ver hidden truths about nature.

But in fact, Lorenz was not the one running the machine. There’s anot­her story, one that has gone untold for half a century. A year and a half ago, an MIT scien­tist happe­ned across a name he had never heard before and star­ted to inves­ti­gate. The trail he ended up follo­wing took him into the MIT archi­ves, through the stacks of the Library of Congress, and across three states and five deca­des to find infor­ma­tion about the women who, today, would have been listed as co-authors on that semi­nal paper. And that mate­rial, shared with Quanta, provi­des a fuller, fairer account of the birth of chaos.

The Birth of Chaos

In the fall of 2017, the geophy­si­cist Daniel Roth­man, co-direc­tor of MIT’s Lorenz Center, was prepa­ring for an upco­ming sympo­sium. The meeting would honor Lorenz, who died in 2008, so Roth­man revi­si­ted Lorenz’s epochal paper, a master­work on chaos titled “Deter­mi­nis­tic Nonpe­ri­o­dic Flow.” Publis­hed in 1963, it has since attrac­ted thou­sands of cita­ti­ons, and Roth­man, having taught this foun­da­ti­o­nal mate­rial to class after class, knew it like an old friend. But this time he saw somet­hing he hadn’t noti­ced before. In the paper’s acknow­ledg­ments, Lorenz had writ­ten, “Special thanks are due to Miss Ellen Fetter for hand­ling the many nume­ri­cal compu­ta­ti­ons.”

“Jesus … who is Ellen Fetter?” Roth­man recalls thin­king at the time. “It’s one of the most impor­tant papers in compu­ta­ti­o­nal physics and, more broadly, in compu­ta­ti­o­nal science, ” he said. And yet he couldn’t find anyt­hing about this woman. “Of all the volu­mes that have been writ­ten about Lorenz, the great disco­very — nothing.”

Ellen Fetter in 1963, the year Lorenz’s semi­nal paper came out.

COUR­TESY OF ELLEN GILLE

With further online sear­ches, howe­ver, Roth­man found a wedding announ­ce­ment from 1963. Ellen Fetter had married John Gille, a physi­cist, and chan­ged her name. A colle­a­gue of Roth­man’s then remem­be­red that a gradu­ate student named Sarah Gille had studied at MIT in the 1990s in the very same depart­ment as Lorenz and Roth­man. Roth­man reached out to her, and it turned out that Sarah Gille, now a physi­cal ocea­no­grap­her at the Univer­sity of Cali­for­nia, San Diego, was Ellen and John’s daugh­ter. Through this connec­tion, Roth­man was able to get Ellen Gille, née Fetter, on the phone. And that’s when he lear­ned anot­her name, the name of the woman who had prece­ded Fetter in the job of program­ming Lorenz’s first meetings with chaos: Marga­ret Hamil­ton.

When Marga­ret Hamil­ton arri­ved at MIT in the summer of 1959, with a freshly minted math degree from Earl­ham College, Lorenz had only recently bought and taught himself to use the LGP-30. Hamil­ton had no prior trai­ning in program­ming either. Then again, neit­her did anyone else at the time. “He loved that compu­ter, ” Hamil­ton said. “And he made me feel the same way about it.”

For Hamil­ton, these were forma­tive years. She recalls being out at a party at three or four a.m., reali­zing that the LGP-30 wasn’t set to produce results by the next morning, and rushing over with a few friends to start it up. Anot­her time, frus­tra­ted by all the things that had to be done to make anot­her run after fixing an error, she devi­sed a way to bypass the compu­ter’s clunky debug­ging process. To Lorenz’s delight, Hamil­ton would take the paper tape that fed the machine, roll it out the length of the hall­way, and edit the binary code with a sharp pencil. “I’d poke holes for ones, and I’d cover up with Scotch tape the others, ” she said. “He just got a kick out of it.”

Edward Lorenz acknow­led­ged the contri­bu­ti­ons of Fetter and Hamil­ton at the end of his papers.

There were desks in the compu­ter room, but because of the noise, Lorenz, his secre­tary, his program­mer and his gradu­ate students all shared the other office. The plan was to use the desk compu­ter, then a total novelty, to test compe­ting stra­te­gies of weat­her predic­tion in a way you couldn’t do with pencil and paper.

First, though, Lorenz’s team had to do the equi­va­lent of catching the Earth’s atmosp­here in a jar. Lorenz idea­li­zed the atmosp­here in 12 equa­ti­ons that descri­bed the motion of gas in a rota­ting, stra­ti­fied fluid. Then the team coded them in.

Some­ti­mes the “weat­her” inside this simu­la­tion would simply repeat like clock­work. But Lorenz found a more inter­es­ting and more realis­tic set of solu­ti­ons that gene­ra­ted weat­her that wasn’t peri­o­dic. The team set up the compu­ter to slowly print out a graph of how one or two vari­a­bles—­say, the lati­tude of the stron­gest westerly winds—­chan­ged over time. They would gather around to watch this imagi­nary weat­her, even placing little bets on what the program would do next.

And then one day it did somet­hing really strange. This time they had set up the prin­ter not to make a graph, but simply to print out time stamps and the values of a few vari­a­bles at each time. As Lorenz later reca­lled, they had re-run a previ­ous weat­her simu­la­tion with what they thought were the same star­ting values, reading off the earlier numbers from the previ­ous prin­tout. But those weren’t actu­ally the same numbers. The compu­ter was keeping track of numbers to six deci­mal places, but the prin­ter, to save space on the page, had roun­ded them to only the first three deci­mal places.

After the second run star­ted, Lorenz went to get coffee. The new numbers that emer­ged from the LGP-30 while he was gone looked at first like the ones from the previ­ous run. This new run had star­ted in a very simi­lar place, after all. But the errors grew expo­nen­ti­ally. After about two months of imagi­nary weat­her, the two runs looked nothing alike. This system was still deter­mi­nis­tic, with no random chance intru­ding between one moment and the next. Even so, its hair-trig­ger sensi­ti­vity to initial condi­ti­ons made it unpre­dic­ta­ble.

This meant that in chao­tic systems the smallest fluc­tu­a­ti­ons get ampli­fied. Weat­her predic­ti­ons fail once they reach some point in the future because we can never measure the initial state of the atmosp­here preci­sely enough. Or, as Lorenz would later present the idea, even a seagull flap­ping its wings might even­tu­ally make a big diffe­rence to the weat­her. (In 1972, the seagull was depo­sed when a confe­rence orga­ni­zer, unable to check back about what Lorenz wanted to call an upco­ming talk, wrote his own title that swit­ched the metap­hor to a butterfly.)

5W INFO­GRAP­HICS/QUANTA MAGA­ZINE

Many accounts, inclu­ding the one in Gleick’s book, date the disco­very of this butterfly effect to 1961, with the paper follo­wing in 1963. But in Novem­ber 1960, Lorenz descri­bed it during the Q&A session follo­wing a talk he gave at a confe­rence on nume­ri­cal weat­her predic­tion in Tokyo. After his talk, a ques­tion came from a member of the audi­ence: “Did you change the initial condi­tion just slightly and see how much diffe­rent results were?”

“As a matter of fact, we tried out that once with the same equa­tion to see what could happen, ” Lorenz said. He then star­ted to explain the unex­pec­ted result, which he wouldn’t publish for three more years. “He just gives it all away, ” Roth­man said now. But no one at the time regis­te­red it enough to scoop him.

In the summer of 1961, Hamil­ton moved on to anot­her project, but not before trai­ning her repla­ce­ment. Two years after Hamil­ton first step­ped on campus, Ellen Fetter showed up at MIT in much the same fashion: a recent gradu­ate of Mount Holyoke with a degree in math, seeking any sort of math-rela­ted job in the Boston area, eager and able to learn. She inter­vi­e­wed with a woman who ran the LGP-30 in the nuclear engi­ne­e­ring depart­ment, who recom­men­ded her to Hamil­ton, who hired her.

Once Fetter arri­ved in Buil­ding 24, Lorenz gave her a manual and a set of program­ming problems to prac­tice, and before long she was up to speed. “He carried a lot in his head, ” she said. “He would come in with maybe one yellow sheet of paper, a legal piece of paper in his pocket, pull it out, and say, ‘Let’s try this.’”

The project had progres­sed meanw­hile. The 12 equa­ti­ons produ­ced fickle weat­her, but even so, that weat­her seemed to prefer a narrow set of possi­bi­li­ties among all possi­ble states, forming a myste­ri­ous clus­ter which Lorenz wanted to visu­a­lize. Finding that diffi­cult, he narro­wed his focus even further. From a colle­a­gue named Barry Saltz­man, he borro­wed just three equa­ti­ons that would describe an even simpler nonpe­ri­o­dic system, a beaker of water heated from below and cooled from above.

Here, again, the LGP-30 chug­ged its way into chaos. Lorenz iden­ti­fied three proper­ties of the system corres­pon­ding roughly to how fast convec­tion was happe­ning in the idea­li­zed beaker, how the tempe­ra­ture varied from side to side, and how the tempe­ra­ture varied from top to bottom. The compu­ter trac­ked these proper­ties moment by moment.

The proper­ties could also be repre­sen­ted as a point in space. Lorenz and Fetter plot­ted the motion of this point. They found that over time, the point would trace out a butterfly-shaped frac­tal struc­ture now called the Lorenz attrac­tor. The trajec­tory of the point—of the system—­would never retrace its own path. And as before, two systems setting out from two minu­tely diffe­rent star­ting points would soon be on totally diffe­rent tracks. But just as profoundly, where­ver you star­ted the system, it would still head over to the attrac­tor and start doing chao­tic laps around it.

The attrac­tor and the system’s sensi­ti­vity to initial condi­ti­ons would even­tu­ally be recog­ni­zed as foun­da­ti­ons of chaos theory. Both were publis­hed in the land­mark 1963 paper. But for a while only mete­o­ro­lo­gists noti­ced the result. Meanw­hile, Fetter married John Gille and moved with him when he went to Florida State Univer­sity and then to Colo­rado. They stayed in touch with Lorenz and saw him at social events. But she didn’t realize how famous he had become.

Still, the notion of small diffe­ren­ces leading to dras­ti­cally diffe­rent outco­mes stayed in the back of her mind. She remem­be­red the seagull, flap­ping its wings. “I always had this image that step­ping off the curb one way or the other could change the course of any field, ” she said.

Flight Checks

After leaving Lorenz’s group, Hamil­ton embar­ked on a diffe­rent path, achi­e­ving a level of fame that rivals or even exce­eds that of her first coding mentor. At MIT’s Instru­men­ta­tion Labo­ra­tory, star­ting in 1965, she headed the onbo­ard flight soft­ware team for the Apollo project.

Her code held up when the stakes were life and death—e­ven when a mis-flip­ped switch trig­ge­red alarms that inter­rup­ted the astro­naut’s displays right as Apollo 11 appro­a­ched the surface of the moon. Mission Control had to make a quick choice: land or abort. But trus­ting the soft­wa­re’s ability to recog­nize errors, prio­ri­tize impor­tant tasks, and reco­ver, the astro­nauts kept going.

Hamil­ton, who popu­la­ri­zed the term “soft­ware engi­ne­e­ring, ” later led the team that wrote the soft­ware for Skylab, the first US space station. She foun­ded her own company in Cambridge in 1976, and in recent years her legacy has been cele­bra­ted again and again. She won NASA’s Excep­ti­o­nal Space Act Award in 2003 and recei­ved the Presi­den­tial Medal of Free­dom in 2016. In 2017 she garne­red arguably the grea­test honor of all: a Marga­ret Hamil­ton Lego mini­fi­gure.

Marga­ret Hamil­ton and an uniden­ti­fied man in 1962 in front of the SAGE compu­ter at MIT’s Lincoln Labo­ra­tory.

COUR­TESY OF MARGA­RET HAMIL­TON

Fetter, for her part, conti­nued to program at Florida State after leaving Lorenz’s group at MIT. After a few years, she left her job to raise her chil­dren. In the 1970s, she took compu­ter science clas­ses at the Univer­sity of Colo­rado, toying with the idea of retur­ning to program­ming, but she even­tu­ally took a tax prepa­ra­tion job instead. By the 1980s, the demo­grap­hics of program­ming had shif­ted. “After I sort of got put off by a couple of job inter­vi­ews, I said forget it, ” she said. “They went with young, techy guys.”

Chaos only reen­te­red her life through her daugh­ter, Sarah. As an under­gra­du­ate at Yale in the 1980s, Sarah Gille sat in on a class about scien­ti­fic program­ming. The case they studied? Lorenz’s disco­ve­ries on the LGP-30. Later, Sarah studied physi­cal ocea­no­graphy as a gradu­ate student at MIT, joining the same overar­ching depart­ment as both Lorenz and Roth­man, who had arri­ved a few years earlier. “One of my office mates in the gene­ral exam, the qualifying exam for doing rese­arch at MIT, was asked: How would you explain chaos theory to your mother?” she said. “I was like, whew, glad I didn’t get that ques­tion.”

The Chan­ging Value of Compu­ta­tion

Today, chaos theory is part of the scien­ti­fic reper­toire. In a study publis­hed just last month, rese­ar­chers conclu­ded that no amount of impro­ve­ment in data gathe­ring or in the science of weat­her fore­cas­ting will allow mete­o­ro­lo­gists to produce useful fore­casts that stretch more than 15 days out. (Lorenz had sugges­ted a simi­lar two-week cap to weat­her fore­casts in the mid-1960s.)

But the many rete­llings of chaos’s birth say little to nothing about how Hamil­ton and Ellen Gille wrote the speci­fic programs that reve­a­led the signa­tu­res of chaos. “This is an all-too-common story in the histo­ries of science and tech­no­logy, ” wrote Jenni­fer Light, the depart­ment head for MIT’s Science, Tech­no­logy and Soci­ety program, in an email to Quanta. To an extent, we can chalk up that omis­sion to the tendency of story­te­llers to focus on soli­tary geniu­ses. But it also stems from tensi­ons that remain unre­sol­ved today.

First, coders in gene­ral have seen their contri­bu­ti­ons to science mini­mi­zed from the begin­ning. “It was seen as rote, ” said Mar Hicks, a histo­rian at the Illi­nois Insti­tute of Tech­no­logy. “The fact that it was asso­ci­a­ted with machi­nes actu­ally gave it less status, rather than more.” But beyond that, and contri­bu­ting to it, many program­mers in this era were women.

In addi­tion to Hamil­ton and the woman who coded in MIT’s nuclear engi­ne­e­ring depart­ment, Ellen Gille recalls a woman on an LGP-30 doing mete­o­ro­logy next door to Lorenz’s group. Anot­her woman follo­wed Gille in the job of program­ming for Lorenz. An analy­sis of offi­cial U.S. labor statis­tics shows that in 1960, women held 27 percent of compu­ting and math-rela­ted jobs.

The percen­tage has been stuck there for a half-century. In the mid-1980s, the frac­tion of women pursuing bache­lor’s degrees in program­ming even star­ted to decline. Experts have argued over why. One idea holds that early perso­nal compu­ters were marke­ted prefe­ren­ti­ally to boys and men. Then when kids went to college, intro­duc­tory clas­ses assu­med a detai­led know­ledge of compu­ters going in, which alie­na­ted young women who didn’t grow up with a machine at home. Today, women program­mers describe a self-perpe­tu­a­ting cycle where white and Asian male mana­gers hire people who look like all the other program­mers they know. Outright harass­ment also remains a problem.

Hamil­ton and Gille, howe­ver, still speak of Lorenz’s humi­lity and mentors­hip in glowing terms. Before later chro­ni­clers left them out, Lorenz than­ked them in the lite­ra­ture in the same way he than­ked Saltz­man, who provi­ded the equa­ti­ons Lorenz used to find his attrac­tor. This was common at the time. Gille recalls that in all her scien­ti­fic program­ming work, only once did some­one include her as a co-author after she contri­bu­ted compu­ta­ti­o­nal work to a paper; she said she was “stun­ned” because of how unusual that was.

Since then, the stan­dard for giving credit has shif­ted. “If you went up and down the floors of this buil­ding and told the story to my colle­a­gues, every one of them would say that if this were going on today … they’d be a co-author!” Roth­man said. “Auto­ma­ti­cally, they’d be a co-author.”

Compu­ta­tion in science has become even more indis­pen­sa­ble, of course. For recent breakth­roughs like the first image of a black hole, the hard part was not figu­ring out which equa­ti­ons descri­bed the system, but how to leve­rage compu­ters to unders­tand the data.

Today, many program­mers leave science not because their role isn’t appre­ci­a­ted, but because coding is better compen­sa­ted in industry, said Alyssa Good­man, an astro­no­mer at Harvard Univer­sity and an expert in compu­ting and data science. “In the 1960s, there was no such thing as a data scien­tist, there was no such thing as Netflix or Google or whoe­ver, that was going to suck in these people and really, really value them, ” she said.

Still, for coder-scien­tists in acade­mic systems that measure success by paper cita­ti­ons, things haven’t chan­ged all that much. “If you are a soft­ware deve­lo­per who may never write a paper, you may be essen­tial, ” Good­man said. “But you’re not going to be coun­ted that way.”

Origi­nal story reprin­ted with permis­sion from Quanta Maga­zine, an edito­ri­ally inde­pen­dent publi­ca­tion of the Simons Foun­da­tion whose mission is to enhance public unders­tan­ding of science by cove­ring rese­arch deve­lop­ments and trends in mathe­ma­tics and the physi­cal and life scien­ces.