Concrete Data Sets: New Online Map of Building Construction Metrics Across New York

Image from Pixabay.com

There is an age-old expression among New Yorkers that their city will really be a great place one day if someone ever finishes building it. I have heard this many times during my life as a native and lifelong resident of this remarkable place.

Public and private construction goes on each day on a vast scale throughout the five boroughs of NYC. Over the past several decades under successive political administrations, many areas have been re-zoned to facilitate and accelerate this never-ending buildup and built-out. This relentless activity produces many economic benefits for the municipal economy. However, it also results in other detrimental effects including housing prices and rents that continue to soar upward, disruptive levels of noise and waste materials affecting people living nearby, increased stresses upon local infrastructure, and just as regrettably, steady erosion of the unique characters and spirits of many neighborhoods.¹

In a significant technological achievement intended to focus and consolidate the massive quantities of location, scope and cost data about the  plethora of structures sprouting up everywhere, on August 22, 2018 the New York City Buildings Department launched an interactive NYC Active Major Construction Map (“The Map”). Full coverage of its inauguration was provided in a very informative article in The New York Times entitled A Real-Time Map Tracks the Building Frenzy That’s Transforming New York, by Corey Kilgannon, on August 22, 2018. (Here, too, is the Building Department’s press release.) I highly recommend both a click-through and full read of it and further online exploration of The Map itself.

I will also summarize and annotate this report, and then pose some of my own code compliant questions.

Home on the [Data] Range

Construction on Lexington Avenue, Image by Jeffrey Zeldman

As the ubiquitous pounding of steel and pouring of concrete proceeds unabated, there is truly little or no getting around it. The Map is one component of a $60 million digital initiative established in 2015 which is intended to produce an “impressive level of detail” on much of this cityscape altering activity.

The recent inception of The Map provides everyone in the metro area an online platform to track some of the key details of the largest of these projects plotted across a series of key metrics.  An accompanying grid of tables below it lists and ordinates the largest projects based upon these dimensions.

The Map’s user interface presents this “overview of the frenzy of construction” dispersed across the city’s communities using the following configurations:

  • Each project’s location represented by a blue dot that can be clicked to reveal the property’s contractor, history and any violations.
  • Cumulative real-time totals of square footage under construction, permits and dwelling units involved. This data can be further filtered by borough.
  • Scrollable and clickable Top 10 lists by project square footage, size, cost and dwelling units

As well, it provides residents a virtual means to identify who is making all of that real-world blaring construction noise in their neighborhood.²

If I Had a Hammer

Executives, organizations and community advocates representing a diversity of interests have expressed their initial support for The Map.

Second Avenue Subway Update, Image by MTA (2)

The NYC Building Commissioner, Rick D. Chandler, believes this new resource is a means to provide transparency to his department’s tremendous quantity of construction data. Prior to the rollout of The Map, accessing and processing this information required much greater technical and professional skills. Furthermore, the data will be put to use to “improve and streamline the department’s operations”.

According to Andrew Berman, the Executive Director of the non-profit advocacy group Greenwich Village Society for Historic Preservation, he finds The Map to be both useful and “long overdue”. It is providing his group with a more convenient means to discover additional information about the proliferation of project sites in the Village. He also noted that under the previously existing municipal databases, this data was far more challenging to extract. Nonetheless, the new map remains insufficient for him and “other measures were needed” for the city government to increase oversight and enforcement of construction regulations concerning safety and the types of projects are permitted on specific properties.

Local real estate industry trade groups such as the Real Estate Board of New York, are also sanguine about this form of digital innovation, particularly for it accessibility. The group’s current president, John H. Banks, finds that it is “more responsive to the needs of the private sector”, raises transparency and the public’s “awareness of economic activity, jobs and tax revenues” flowing from the city’s construction projects.

Plans are in place to expand The Map based upon user feedback. As well, it will receive daily updates thus providing “a real-time advantage over analyst and industry reports”.

Image from Pixabay.com

My Questions

  • Does a roadmap currently exist for the projected development path of The Map’s content and functionality? If so, how can all interested parties provide ongoing commentary and support for it?
  • Are there other NYC databases and data sources that could possibly be integrated into the map? For example, tax, environmental and regulatory information might be helpful.
  • Can other cities benefit from the design and functionality of The Map to create or upgrade their own versions of similar website initiatives?
  • What new entrepreneurial, academic and governmental opportunities might now present themselves because of The Map?
  • How might artificial intelligence and/or machine learning capabilities be, well, mapped into The Map’s functionalities? Are there any plans to add chatbot scripting capabilities to The Map?

 


Two related Subway Fold posts covering other aspects of construction include:


1.  For a deeply insightful analysis and passionate critique of the pervasive and permanent changes to many of New York’s neighborhoods due to a confluence of political, economic and social forces and interests, I highly recommend reading Vanishing New York: How a Great City Lost Its Soul, by Jeremiah Moss, (Dey Street Books, 2017). While I did not agree with some aspects of his book, the author has expertly captured and scrutinized how, where and why this great city has been changed forever in many ways. (See also the author’s blog Jeremiah’s Vanishing New York for his continuing commentary and perspectives.)

2.  Once I lived in a building that had been mercifully quiet for a long time until the adjacent building was purchased, gutted and totally renovated. For four months during this process, the daily noise level by comparison made a typical AC/DC concert sound like pin drop.

Text Analysis Systems Mine Workplace Emails to Measure Staff Sentiments

Image from Pixabay.com

Have you ever been employed in a genuinely cooperative and productive environment where you looked forward each day to making your contribution to the enterprise and assisting your colleagues? Conversely, have you ever worked in a highly stressful and unsupportive atmosphere where you dreading going back there nearly every day?  Or perhaps you have found in your career that your jobs and employers were somewhere in the mid-range of this spectrum of office cultures.

For all of these good, bad or indifferent workplaces, a key question is whether any of the actions of management to engage the staff and listen to their concerns ever resulted in improved working conditions and higher levels of job satisfaction?

The answer is most often “yes”. Just having a say in, and some sense of control over, our jobs and workflows can indeed have a demonstrable impact on morale, camaraderie and the bottom line. As posited in the Hawthorne Effect, also termed the “Observer Effect”, this was first discovered during studies in the 1920’s and 1930’s when the management of a factory made improvements to the lighting and work schedules. In turn, worker satisfaction and productivity temporarily increased. This was not so much because there was more light, but rather, that the workers sensed that management was paying attention to, and then acting upon, their concerns. The workers perceived they were no longer just cogs in a machine.

Perhaps, too, the Hawthorne Effect is in some ways the workplace equivalent of the Heisenberg’s Uncertainty Principle in physics. To vastly oversimplify this slippery concept, the mere act of observing a subatomic particle can change its position.¹

Giving the processes of observation, analysis and change at the enterprise level a modern (but non-quantum) spin, is a fascinating new article in the September 2018 issue of The Atlantic entitled What Your Boss Could Learn by Reading the Whole Company’s Emails, by Frank Partnoy.  I highly recommend a click-through and full read if you have an opportunity. I will summarize and annotate it, and then, considering my own thorough lack of understanding of the basics of y=f(x), pose some of my own physics-free questions.

“Engagement” of Enron’s Emails

By Enron [Public domain], via Wikimedia Commons

Andrew Fastow was the Chief Financial Officer of Enron when the company infamously collapsed into bankruptcy in December 2001. Criminal charges were brought against some of the corporate officers, including Fastow, who went to prison for six years as a result.

After he had served his sentence he became a public speaker about his experience. At one of his presentations in Amsterdam in 2016, two men from the audience approached him. They were from KeenCorp, whose business is data analytics. Specifically, their clients hire them to analyze the email “word patterns and their context” of their employees. This is done in an effort to quantify and measure the degree of the staff’s “engagement”. The resulting numerical rating is higher when they feel more “positive and engaged”, while lower when they are unhappier and less “engaged”.

The KeenCorp representatives explained to Fastow that they had applied their software to the email archives of 150 Enron executives in an effort to determine “how key moments in the company’s tumultuous collapse” would be assessed and a rated by their software. (See also the February 26, 2016 Subway Fold post entitled The Predictive Benefits of Analyzing Employees’ Communications Networks, covering, among other things, a similar analysis of Enron’s emails.)

KeenCorp’s software found the lowest engagement score when Enron filed for bankruptcy. However, the index also took a steep dive two years earlier. This was puzzling since the news about the Enron scandal was not yet public. So, they asked Fastow if he could recall “anything unusual happening at Enron on June 28, 1999”.

Sentimental Journal

Milky Way in Mauritius, Image by Jarkko J

Today the text analytics business, like the work done by KeenCorp, is thriving. It has been long-established as the processing behind email spam filters. Now it is finding other applications including monitoring corporate reputations on social media and other sites.²

The finance industry is another growth sector, as investment banks and hedge funds scan a wide variety of information sources to locate “slight changes in language” that may point towards pending increases or decreases in share prices. Financial research providers are using artificial intelligence to mine “insights” from their own selections of news and analytical sources.

But is this technology effective?

In a paper entitled Lazy Prices, by Lauren Cohen (Harvard Business School and NBER), Christopher Malloy (Harvard Business School and NBER), and Quoc Nguyen (University of Illinois at Chicago), in a draft dated February 22, 2018, these researchers found that the share price of company, in this case NetApp in their 2010 annual report, measurably went down after the firm “subtly changes” its reporting “descriptions of certain risks”. Algorithms can detect such changes more quickly and effectively than humans. The company subsequently clarified in its 2011 annual report their “failure to comply” with reporting requirements in 2010. A highly skilled stock analyst “might have missed that phrase”, but once again its was captured by “researcher’s algorithms”.

In the hands of a “skeptical investor”, this information might well have resulted in them questioning the differences in the 2010 and 2011 annual reports and, in turn, saved him or her a great deal of money. This detection was an early signal of a looming decline in NetApp’s stock. Half a year after the 2011 report’s publication, it was reported that the Syrian government has bought the company and “used that equipment to spy on its citizen”, causing further declines.

Now text analytics is being deployed at a new target: The composition of employees’ communications. Although it has been found that workers have no expectations of privacy in their workplaces, some companies remain reluctant to do so because of privacy concerns. Thus, companies are finding it more challenging to resist the “urge to mine employee information”, especially as text analysis systems continue to improve.

Among the evolving enterprise applications are the human resources departments in assessing overall employee morale. For example, Vibe is such an app that scans through communications on Slack, a widely used enterprise platform. Vibe’s algorithm, in real-time reporting, measures the positive and negative emotions of a work team.

Finding Context

“Microscope”, image by Ryan Adams

Returning to KeenCorp, can their product actually detect any wrongdoing by applying text analysis? While they did not initially see it, the company’s system had identified a significant “inflection point” in Enron’s history on the June 28, 1999 date in question. Fastow said that was the day the board had discussed a plan called “LJM”, involving a group of questionable transactions that would mask the company’s badly under-performing assets while improving its financials. Eventually, LJM added to Enron’s demise. At that time, however, Fastow said that everyone at the company, including employees and board members, was reluctant to challenge this dubious plan.

KeenCorp currently has 15 employees and six key clients. Fastow is also one of their consultants and advisors. He also invested in the company when he saw their algorithm highlight Enron’s employees’ concerns about the LJM plan. He hopes to raise potential clients’ awareness of this product to help them avoid similar situations.

The company includes heat maps as part of its tool set to generate real-time visualizations of employee engagement. These can assist companies in “identifying problems in the workplace”. In effect, it generates a warning (maybe a warming, too), that may help to identify significant concerns. As well, it can assist companies with compliance of government rules and regulations. Yet the system “is only as good as the people using it”, and someone must step forward and take action when the heat map highlights an emerging problem.

Analyzing employees’ communications also presents the need for applying a cost/benefit analysis of privacy considerations. In certain industries such as finance, employees are well aware that their communications are being monitored and analyzed, while in other businesses this can be seen “as intrusive if not downright Big Brotherly”. Moreover, managers “have the most to fear” from text analysis systems. For instance, it can be used to assess sentiment when someone new is hired or given a promotion. Thus, companies will need to find a balance between the uses of this data and the inherent privacy concerns about its collection.

In addressing privacy concerns about data collection, KeenCorp does not “collect, store on report” info about individual employees. All individually identifying personal info is scrubbed away.

Text analysis is still in its early stages. There is no certainty yet that it may not register a false positive reading and that it will capture all emerging potential threats. Nonetheless it is expected to continue to expand and find new fields for application. Experts predict that among these new areas will be corporate legal, compliance and regulatory operations. Other possibilities include protecting against possible liabilities for “allegations of visa, fraud and harassment”.

The key takeaway from the current state of this technology is to ascertain the truth about employees’ sentiments not by snooping, but rather, “by examining how they are saying it”.

My Questions

  • “Message In a Bottle”, Image from Pixabay.com

    Should text analysis data be factored into annual reviews of officers and/or board members? If so, how can this be done and what relative weight should it be given?

  • Should employees at any or all levels and departments be given access to text analysis data? How might this potentially impact their work satisfaction and productivity?
  • Is there a direct, casual or insignificant relationship between employee sentiment data and up and/or down movements in market value? If so, how can companies elevate text analysis systems to higher uses?
  • How can text analysis be used for executive training and development? Might it also add a new dimension to case studies in business schools?
  • What does this data look like in either or both of short-term and long-term time series visualizations? Are there any additional insights to be gained by processing the heat maps into animations to show how their shape and momentum are changing over time?

 


1.  See also the May 20, 2015 Subway Fold post entitled A Legal Thriller Meets Quantum Physics: A Book Review of “Superposition” for the application of this science in a hard rocking sci-fi novel.

2These 10 Subway Fold posts cover other measurements of social media analytics, some including other applications of text analytics.

Book Review of “Frenemies: The Epic Disruption of the Ad Business (and Everything Else)”

“Advertising in Times Square”, image by Dirk Knight

Every so often, an ad campaign comes along that is strikingly brilliant for its originality, execution, persuasiveness, longevity, humor and pathos. During the mid-1980’s, one of these bright shining examples was the television ads for Bartles & Jaymes Wine Coolers. They consisted of two fictional characters: Frank Bartles, who owned a winery and did all of the talking, and Ed Jaymes, a farmer who never spoke a word but whose deadpan looks were priceless. They traveled across the US to different locations in pursuit of sales, trying to somehow adapt their approaches to reflect the local surroundings. Bartles was very sincere but often a bit naive in his pitches along the way, best exemplified in this ad and another one when they visited New York.

These commercials succeeded beyond all expectations in simultaneously establishing brand awareness, boosting sales and being laugh-out-loud hilarious because Bartles’s and Jaymes’s were such charming, aw-shucks amateurs. In actuality, these ads were deftly conceived and staged by some smart and savvy creatives from the Hal Riney & Partners agency. For further lasting effect, they always had Bartles express his appreciation to the viewers at the end of each spot with his memorable trademark tagline of “Thanks for your support”. These 30-second video gems are as entertaining today as they were thirty years ago.

But those halcyon days of advertising are long gone. The industry’s primary media back then was limited to print, television and radio. Creativity was its  cornerstone and the words “data analytics” must have sounded like something actuaries did in a darkened room while contemplating the infinite. (Who knows, maybe it still does to some degree.)

Fast forwarding to 2018, advertising is an utterly different and hyper-competitive sector whose work product is largely splayed across countless mobile and stationary screens on Planet Earth. Expertly chronicling and precisely assaying the transformative changes happening to this sector is an informative and engaging new book entitled Frenemies: The Epic Disruption of the Ad Business (and Everything Else) [Penguin Press, 2018], by the renowned business author Ken Auletta. Just as a leading ad agency in its day cleverly and convincingly took TV viewers on an endearing cultural tour of the US as we followed the many ad-ventures of Bartles & Jaymes, so too, this book takes its readers on a far-ranging and immersive tour of the current participants, trends, challenges and technologies affecting the ad industry.

A Frenemy of My Frenemy is My Frenemy

Image from Pixabay

This highly specialized world is under assault from a confluence of competitive, online, economic, social and mathematical forces. Many people who work in it are deeply and rightfully concerned about its future and the tenure of their places in it. Auletta comprehensively reports on and assesses these profound changes from deep within the operations of several key constituencies (the “frenemies”, conflating “friend” and “enemy”). At first this might seem a bit too much of “inside baseball” (although the ad pitch remains alive and well), but he quickly and efficiently establishes who’s who and what’s what in today’s morphing ad markets, making this book valuable and accessible to readers both within and outside of this field.  It can also be viewed as a multi-dimensional case study of an industry right now being, in the truest sense of the word, disrupted.¹ There is likewise much to learned and considered here by other businesses being buffeted by similar winds.

Frenemies, as thoroughly explored throughout this book, are both  business competitors and partners at the same time. They are former and current allies in commerce who concurrently cooperate and compete. Today they are actively infiltrating each other’s markets. The full matrix of frenemies and their threats and relationships to each other includes the interests and perspectives of ad agencies and their clients, social media networks, fierce competition from streamers and original content producers like Netflix², traditional media in transition to digital platforms, consulting companies and, yes, consumers.

Auletta travels several parallel tracks in his reporting. First, he examines the past, present on onrushing future with respect to revenue streams, profits, client bases served, artificial intelligence (AI) driven automation, and the frenemies’ very fluid alliances. Second, he skillfully deploys the investigative journalistic strategy of “following the money” as it ebbs and flows in many directions among the key players. Third, he illuminates the industry’s evolution from Don Draper’s traditional “Mad Men” to 2018’s “math men” who are the data wranglers, analysts and strategists driven by ever more thin-sliced troves of consumer data the agencies and their corporate clients are using to achieve greater accuracy and efficiency in selling their goods and services.

A deep and wide roster of C-level executives from these various groups were interviewed for the book. Chief among them are two ad industry legends who serve as the x and y axes upon which Auletta has plotted a portion of his reporting. One is Martin Sorrell, who was the founder and CEO of WPP, the world’s largest advertising holding company.³ The other is Michael Kassan, the founder and CEO of MediaLink, a multifaceted firm that connects, negotiates and advises on behalf of a multitude of various parties, often competitors in critical matters affecting the ad business. Both of these individuals have significantly shaped modern advertising over many decades and are currently propagating some of the changes spotlighted in the book in trying to keep it vital, relevant and profitable.

Online Privacy v. Online Primacy

“Tug of War”, image by Pixabay

The established tradition of creativity being the primary driver of advertising creation and campaigns has given way to algorithm-driven data analytics. All of the frenemies and a myriad of other sites in many other parsecs of the websphere vacuum up vast amounts of data on users, their online usage patterns, and even go so far as to try to infer their behavioral attributes. This is often combined with additional personal information from third-party sources and data brokers. Armed with all of this data and ever more sophisticated means for sifting and intuiting it, including AI4, the frenemies are devising their campaigns to far more precisely target potential consumers and their cohorts with finely grained customized ads.

The high point of this book is Auletta’s nuanced coverage of the ongoing controversy involving the tension between frenemies using data analytics to increase click-through rates and, hopefully, sales versus respecting the data privacy of people as they traverse the Web. In response to this voracious data collection, millions of users have resisted this intrusiveness by adding free browser extensions such as AdBlock Plus to circumvent online tracking and ad distribution.5 This struggle has produced a slippery slope between the commercial interests of the frenemies and consumers’ natural distaste for advertising, as well as their resentment at having their data co-opted, appropriated and misused without their knowledge or consent. Recently, public and governmental concerns were dramatically displayed in the harsh light of the scandals involving Facebook and Cambridge Analytica.

Furthermore, Google and Facebook dominate the vast majority of online advertising traffic, revenues and, most importantly, the vast quantum of user information which ad agencies believe would be particularly helpful to them in profiling and reaching consumers. Nonetheless, they maintain it is highly proprietary to them alone and much of it has not been shared. Frenemies much?

Additional troubling trends for the ad industry are likewise given a thorough 3-D treatment. Auletta returns to the axiom several times that audiences do not want to be interrupted with ads (particularly on their mobile devices). Look no further than the likes of premium and the major streaming services who offer all of their content uninterrupted in its entirety. The growing ranks of content creators they engage know this and prefer it because they can concentrate on their presentations without commercial breaks slicing and dicing their narrative continuity. The still profitable revenue streams flowing from this are based upon the strengths of the subscription model.

Indeed, in certain cases advertising is being simultaneously disrupted and innovated. Some of the main pillars of the media like The New York Times are now expanding their in-house advertising staff and service offerings. They can offer a diversified array of ads and analyses directly to their advertisers. Likewise, engineering-driven operations like Google and Facebook can deploy their talent benches to better target consumers for their advertisers by extracting and applying insights from their massive databases. Why should their clients continue go to the agencies when their ads can be composed and tracked for them directly?

Adapt or Go Home

“Out with the Old, In with the New”, image by Mark

The author presents a balanced although not entirely sanguine view of the ad industry’s changes to maintain its composure and clients in the midst of this storm. The frenemy camps must be willing to make needed and often difficult adjustments to accommodate emerging technological and strategic survival methods. He examines the results of two contemporary approaches to avoiding adblocking apps and more fully engaging very specific audiences. One is called “native advertising“, which involves advertisers producing commercial content and paying for its placement online or in print to promote their own products. Generally, these are formatted and integrated to appear as though they are integrated with a site’s or publication’s regular editorial content but contain a notice that it is, in fact “Advertising”.

However, Auletta believes that the second adaptive mechanism, the online subscription model, will not be much more sustainable beyond its current successes. Consumers are already spending money on their favorite paywalled sites.  But it would seem logical that users might not be thus willing to pay for Facebook and others that have always been free. As well, cable’s cord-cutters are continuing to exhibit steady growing in their numbers and their migrations towards streaming services such as Amazon Prime.6

Among the media giants, CBS seems to be getting their adaptive strategies right from continuing to grow multiple revenue streams. They now have the legal rights and financial resources to produce and sell original programming. They have also recently launched original web programming such as Star Trek: Discovery on a commercial-free subscription basis on CBS All Access. This can readily be seen as a challenge to Netflix despite the fact that CBS also providing content to Netflix. Will other networks emulate this lucrative and eyeball attracting model?

As Auletta also concludes, for now at least, consumers as frenemies, appear to be the beneficiaries of all this tumult. They have many device agnostic platforms, pricing options and a surfeit of content from which to choose. They can also meaningfully reduce, although not entirely eliminate, ads following them all over the web and those pesky stealth tracking systems. Whether they collectively can maintain their advantage is subject to sudden change in this environment.

Because of the timing of the book’s completion and publication, the author and publisher should consider including in any subsequent edition the follow-up impacts of Sorrell’s departure from WPP and his new venture (S4 Capital), the effects of the May 2018 implementation of EU’s General Data Protection Regulation (GDPR), and the progress of any industry or government regulation following the raft of recent massive data breaches and misuses.

Notwithstanding that, however, “Frenemies” fully delivers on all of its book jacket’s promises and premises. It is a clear and convincing case of truth in, well, advertising.

So, how would Frank Bartles and Ed Jaymes 2.0 perceive their promotional travels throughout today’s world? Would their folksy personas play well enough on YouTube to support a dedicated channel for them? Would their stops along the way be Instagram-able events? What would be their reactions when asked to Google something or download a podcast?

Alternatively, could they possibly have been proto-social media influencers who just showed up decades too soon? Nah, not really. Even in today’s digital everything world, Frank and Ed 1.0 still abide. Frank may have also unknowingly planted a potential meme among today’s frenemies with his persistent proclamations of “Thanks for your support”: The 2018 upgrade might well be “Thanks for your support and all of your data”.

 


For a very enlightening interview with Ken Auletta, check out the June 26, 2018 podcast entitled Game Change: How the Ad Business Got Disrupted, from The Midday Show on WNYC (the local NPR affiliate in New York).


September 4, 2018 Update: Today’s edition of The New York Times contains an highly enlightening article directly on point with many of the key themes of Frenemies entitled Amazon Sets Its Sights on the $88 Billion Online Ad Market, by Julie Creswell. The report details Amazon’s significant move into online advertising supported by its massive economic, data analytics, scaling and strategic resources. It comprehensively analyzes the current status and future prospects of the company’s move into direct competition with Google and Facebook in this immense parsec of e-commerce. I highly recommend a click-through and full read of this if you have an opportunity.


1.   The classic work on the causes and effect of market disruptions, the disruptors and those left behind is The Innovator’s Dilemma, by Clayton Christensen (HarperBusiness, 2011). The first edition of the book was published in 1992.

2.    Netflix Topples HBO in Emmy Nominations, but ‘Game of Thrones’ Still Rules, July 13, 2018, New York Times, by The Associated Press. However, see also Netflix Drops Dud on Wall St. As Subscriber Growth Flops, July 16, 2018, New York Times, by Reuters.

3.   Sorrell is reported in the book as saying he would not leave anytime soon from running WPP. However, following the book’s publication, he was asked to step down in April 2018 following allegations of inappropriate conduct. See Martin Sorrell Resigns as Chief of WPP Advertising Agency, New York Times, by Matt Stevens and Liz Alderman, April 14, 2018. Nonetheless, Sorrell has quickly returned to the industry as reported in Martin Sorrell Beats WPP in Bidding War for Dutch Marketing Firm, New York Times, by Sapna Maheshwari, July 10, 2018.

4.  For a very timely example, see The Ad Agency Giant Omnicom Has Created a New AI Tool That is Poised to Completely Change How Ads Get Made, BusinessInsider.com, by Lauren Johnson,  July 12, 2018.

5.   Two other similar anti-tracking browser extensions in wide usage include, among others Ghostery and Privacy Badger.

6.   See also  Cord-Cutting Keeps Churning: U.S. Pay-TV Cancelers to Hit 33 Million in 2018 (Study), Variety.com, by Todd Spangler, July 24, 2018.

Single File, Everyone: The Advent of the Universal Digital Profile

Ducks at Parramatta, Image by Stilherrian

Throughout grades 1 through 6 at Public School 79 in Queens, New York, the teachers had one universal command they relied upon to try to quickly gather and organize the students in each class during various activities. They would announce “Single file, everyone”, and expect us all to form a straight line with one student after the other all pointed in the same direction. They would usually deploy this to move us in an orderly fashion to and from the lunchroom, schoolyard, gym and auditorium. Not that this always worked as several requests were usually required to get us all to quiet down and line up.

Just as it was used back then as a means to bring order to a room full of energetic grade-schoolers,  those three magic words can now be re-contextualized and re-purposed for today’s digital everything world when applied to a new means of bringing more control and safety to our personal data. This emerging mechanism is called the universal digital profile (UDP). It involves the creation of a dedicated file to compile and port an individual user’s personal data, content and usage preferences from one online service to another.

This is being done in an effort to provide enhanced protection to consumers and their digital data at a critical time when there have been so many online security breaches of major systems that were supposedly safe. More importantly, these devastating hacks during the past several years have resulted in the massive betrayals of users’ trust that need to be restored.

Clearly and concisely setting the stage for the development of UDPs was an informative article on TechCrunch.com entitled The Birth of the Universal Digital Profile, by Rand Hindi, posted on May 22, 2018. I suggest reading it in its entirety. I will summarize and annotate it, and then pose some of my own questions about these, well, pro-files.

Image from Pixabay

The Need Arises

It is axiomatic today that there is more concern over online privacy among Europeans than other populations elsewhere. This is due, in part, to the frequency and depth of the above mentioned deliberate data thefts. These incidents and other policy considerations led to the May 25, 2018 enactment and implementation of the General Data Protection Regulation (GDPR) across the EU.

The US is presently catching up in its own citizens’ levels of rising privacy concerns following the recent Facebook and Cambridge Analytica scandal.¹

Among its many requirements, the GDPR ensures that all individuals have the right to personal data portability, whereby the users of any online services can request from these sites that their personal data can be “transferred to another provider, without hindrance”. This must be done in a file format the receiving provider requires. For example, if a user is changing from one social network to another, all of his or her personal data is to be transferred to the new social network in a workable file format.

The exact definition of “personal profile” is still open to question. The net effect of this provision is that one’s “online identity will soon be transferable” to numerous other providers. As such transfer requests increase, corporate owners of such providers will likely “want to minimize” their means of compliance. The establishment of standardized data formats and application programming interfaces (APIs) enabling this process would be a means to accomplish this.²

Aurora Borealis, Image by Beverly

A Potential Solution

It will soon become evident to consumers that their digital profiles can become durable, reusable and, hence, universal for other online destinations. They will view their digital profiles “as a shared resource” for similar situations. For instance, if a user has uploaded his or her profile to a site for verification, in turn, he or she should be able to re-use such a “verified profile elsewhere”.³  

This would be similar to the Facebook Connect’s functionality but with one key distinction: Facebook would retain no discretion at all over where the digital profile goes and who can access it following its transfer. That control would remain entirely with the profile’s owner.

As the UDP enters the “mainstream” usage, it may well give rise to “an entire new digital economy”. This might include new services such as “personal data clouds to personal identity aggregators or data monetization platforms”. In effect, increased interoperability between and among sites and services for UDPs might enable these potential business opportunities to take root and then scale up.

Digital profiles, especially now for Europeans, is one of the critical “impacts of the GDPR” on their online lives and freedom. Perhaps its objectives will spread to other nations.

My Questions

  • Can the UDP’s usage be expanded elsewhere without the need for enacting GDPR-like regulation? That is, for economic, public relations and technological reasons, might online services support UDPs on their own initiatives rather than waiting for more governments to impose such requirements?
  • What additional data points and functional capabilities would enhance the usefulness, propagation and extensibility of UDPs?
  • What other business and entrepreneurial opportunities might emerge from the potential web-wide spread of a GDPR and/or UDP-based model?
  • Are there any other Public School 79 graduates out there reading this?

On a very cold night in New York on December 20, 2017, I had an opportunity to attend a fascinating presentation  by Dr. Irene Ng before the Data Scientists group from Meetup.com about an inventive alternative for dispensing one’s personal digital data called the Hub of All Things (HAT). [Clickable also @hubofallthings.] In its simplest terms, this involves the provision of a form of virtual container (the “HAT” situated on a “micro-server”), storing an individual’s personal data. This system enables the user to have much more control over whom, and to what degree, they choose to allow access to their data by any online services, vendors or sites. For the details on the origin, approach and technology of the HAT, I highly recommend a click-through to a very enlightening new article on Medium.com entitled What is the HAT?, by Jonathan Holtby, posted yesterday on June 6, 2018.


1.  This week’s news bring yet another potential scandal for Facebook following reports that they shared extensive amounts of personal user data with mobile device vendors, including Huawei, a Chinese company that has been reported to have ties with China’s government and military. Here is some of the lead coverage so far from this week’s editions of The News York Times:

2.  See also these five Subway Fold posts involving the use of APIs in other systems.

3.  See Blockchain To The Rescue Creating A ‘New Future’ For Digital Identities, by Roger Aitlen, posted on Forbes.com on January 7, 2018, for a report on some of the concepts of, and participants in, this type of technology.

Mary Meeker’s 2018 Massive Internet Trends Presentation

“Blue Marble – 2002”, Image by NASA Goddard Space Flight Center

Yesterday, on May 30, 2018, at the 2018 Code Conference being held this week in Rancho Palos Verdes, California, Mary Meeker, a world-renowned Internet expert and partner in the venture capital firm Kleiner Perkins, presented her seventeenth annual in-depth and highly analytical presentation on current Internet trends. It is an absolutely remarkable accomplishment that is highly respected throughout the global technology industry and economy. The video of her speech is available here on Recode.com.

Her 2018 Internet Trends presentation file is divided into a series of twelve main sections covering, among many other things: Internet user, usage and devices growth rates; online payment systems; content creation; voice interfaces’ significant potential;  user experiences; Amazon’s and Alibaba’s far-reaching effects; data collection, regulation and privacy concerns; tech company trends and investment analyses; e-commerce sectors, consumers experiences and emerging trends;  social media’s breadth, revenue streams and influences; the grown and returns of online advertising; changes in consumer spending patterns and online pricing; key transportation, healthcare and demographic patterns;  disruptions in how, where and whether we work; increasingly sophisticated data gathering, analytics and optimization; AI trends, capabilities and market drivers; lifelong learning for the workforce; many robust online markets in China for, among many, online retail, mobile media and entertainment services; and a macro analysis of the US economy and online marketplaces.

That is just the tip of the tip of the iceberg in this 294-slide deck.

Ms. Meeker’s assessments and predictions here form an extraordinarily comprehensive and insightful piece of work. There is much here for anyone and everyone to learn and consider in the current and trending states nearly anything and everything online. Moreover, there are likely many potential opportunities for new and established businesses, as well as other institutions, within this file.

I very highly recommend that you set aside some time to thoroughly read through and fully immerse your thoughts in Ms. Meeker’s entire presentation. You will be richly rewarded with knowledge and insight that can potentially yield a world of informative, strategic and practical dividends.


September 15, 2018 Update: Mary Meeker has left Kleiner Perkins to start her own investment firm. The details of this are reported in an article in the New York Times entitled Mary Meeker, ‘Queen of the Internet,’ Is Leaving Kleiner Perkins to Start a New Fund, by Erin Griffith, posted on September 14, 2018. I wish her the great success for her new venture. I also hope that she will still have enough time that she can continue to publish her brilliant annual reports on Internet trends.

TechDay New York 2018: 500 Local Startups’ Displays, Demos and Delights for the Crowd

All photos on this page by Alan Rothman.

Sometimes in traditional advertising for creative works like movies, TV shows, books and plays, the quoted reviews and taglines include the exclamation “This one’s got it all!” Yet this is only rarely, if ever, true.

Well, wait a minute. Let’s check that.

Last Thursday, May 10th, I had the great pleasure of attending TechDay New York 2018, held at Pier 94, on the West Side of midtown Manhattan. This is a monumental annual exhibition of 500 startups located throughout NYC almost did have it all. In addition to all of these new companies, there were separate areas set up for brief products and services demos and talks by industry experts. Even the TV show Shark Tank was on site there.

First and foremost, massive amounts of thanks to everyone at Techday for putting on such a terrifically enjoyable, informative and memorable event. Their efforts clearly showed that they worked long and hard to get everything about it right.

On to the show …

One of New York City’s greatest economic and cultural strengths has always been its incredible global diversity of it population. So, too, is that dynamic comparably evident in the breadth of it startup ecosystem. From one end of Pier 94 to the other, there was artificial intelligence this, blockchain that, and data analytics everything infused everywhere.

Just a sampling of who and what were on display, among many others, were startups in legal services, architecture, editorial software, video search, incubators and accelerators, social media support services, event planning platforms, programmer aptitude testing, intellectual property protection, pharmacy order and delivery services, office design consultants, branding and digital experience designers, augmented and virtual reality hardware and software, venture capitalist, crowdfunding services, multi-platform public relations strategists, fashion designers, food services (some displaying much chocolate!), consumer data tracking analyst, competitive intelligence trackers and analysts, restaurant reservations, media consultants, phone apps, online security planning and systems, fully integrated electronic health records and billing systems, and dedicated tech recruiters as well as exhibitors themselves looking for new talent. Whew!

Notwithstanding the vastness of the exhibition space, hundreds of startups and thousands of attendees, the organization and presentations of the startups’ display areas was well planned and easy to navigate. The startups were grouped in helpful sectors for social media, e-commerce, fintech and others into more general categories.

The three among the twelve TechDay Talks I attended were quite compelling and evinced great enthusiasm by both the speakers and their audiences. These included:

Above all other considerations, I found every entrepreneur I stopped and spoke with, asking them to tell me about their company, to be highly enthusiastic, engaging and sincere. They were knowledgeable about their markets and competitors, sounded willing to adapt to changing market conditions and, most importantly, convinced that they would become successful. At no point did any of them move on to their next visitors until they sensed that I understood what they were saying and encouraging me to follow their progress online. They were not so much giving visitors hard sales pitches, but rather, much more of the who, what, where, how and when of their businesses. My gratitude to all of them for their patience with me and many of the other attendees I saw them talking to with the same level of professionalism.

Below are some of the photos I took while I was there. I was trying to capture some sense of infectious energy and engagement being generated across entire day’s events.

My very best wishes to all 500 startups to succeed and prosper.

 


 *   For some very worthwhile deep and wide analysis of the effects of AI upon current and future employment, I highly recommend the recently published book entitled Human + Machine: Reimagining Work in the Age of AI, by Paul Daugherty (Harvard Business Review Press, 2018).


 

 

 

 

 

Book Review of “Built: The Hidden Stories Behind Our Structures”

“Brooklyn Bridge”, Image by Antti-Jussi Kovalainen

During the summer of 2010, I worked in an office directly across the street from the World Trade Center reconstruction site. For several months while my floor was being renovated, my temporary office windows faced west looking out onto the early construction of One World Trade Center. The daily swirl of highly coordinated planning and building was one of the most remarkable things I have ever seen. Hundreds of specialized craftsmen, managers, engineers, materials suppliers and numerous more worked in complete sync with each other to precisely anchor and assemble the tremendous base of the structure. Then they began steadily assembling the 104 stories of steel, concrete and glass above it climbing inexorably towards the sky.

Each day I looked out the windows and marveled at this modern miracle as it continually coalesced into one of the tallest buildings in the world.It was as exciting and entertaining to watch in person as any concert, movie or ballgame.

So, how did this magnificent monolith go from blueprints and computer visualizations to a finely tapered tower expressly intended to endure over time, meet all the modern business and technological needs of its occupants, embed environmental comfort, ensure local building code compliance, and remain state-of-the-art safe? Quite simply, who makes sure that buildings like this and many other structures such as bridges and stadiums actually stand up straight and stay that way?

Measure Twice

“The Shard”, Image by Mike Dixson

Among the many key participants in these processes are the structural engineers. They play an integral part in making certain that everything built is comprehensively planned and assembled strictly in accordance with all relevant design specifications. Yet might this sound a bit too math-geeky to want to learn anything more about them? Well, not anymore.

First-time author and accomplished structural engineer Roma Agrawal ( @RomaTheEngineer ), has recently written a fully engaging, highly informative and deeply inspiring 360-degree look at the work of these professionals entitled Built: The Hidden Stories Behind Our Structures, (Bloomsbury Publishing Plc, 2018). She has admirably transposed the same high standards of skill and precision required to be a structural engineer into also being a writer.

In equal parts personal story, travel log, history lesson and Intro to Structural Engineering 101, Ms. Agrawal quickly captures the reader’s attention and deftly manages to maintain it throughout all 271 pages. From mud huts to coliseums to bridge to skyscrapers (among other projects, she worked on The Shard in London), we learn about who was responsible and how these creations were conceived and realized. For instance, when we admire the artistry of an archway in a building, we usually never consider all of the math, physics and fabrication2 that go into creating it. Built will give you an entirely new point of view on this and a multitude of other fundamentals of structural engineering. The text also contains a wealth of historical perspectives on how bridges, tunnels, buildings and even sewers helped civilizations to expand their populations, civil services and commerce.

The author also believes that structural engineers do not get the credit they really deserve. Nonetheless, her book is a persuasive brief for their successes in making all structures remain standing (including London Bridge and why it is not falling down), function properly, and endure extreme weather conditions and changing geological factors.  In effect, it expertly explains how they carefully process and manage a myriad of concerns about their buildings’ operations, longevity and safety.

By virtue of its own structure, the book’s 14 chapters covering building materials, design and safety principles, construction methods, noteworthy construction projects, and famous structural engineers span widely across the globe and many centuries. The lively prose is involving and evocative, so much so that these chapters could even stand on their own as individual essays. But read sequentially the mesh together to deliver a very rewarding reading experience.

Generously appointing the text are many accompanying hand-annotated photos and hand-drawn simple sketches delineating the critical principles and features being described. These simple graphics significantly support in the reader’s comprehension of some of the more sophisticated concepts as they are introduced.

Cut Once

The Colosseum, Rome, Image by Christopher Chan

There are three important themes skillfully threaded throughout the book. First, in support of the popular current movement to encourage more young women to pursue studies and employment in the fields of science, technology, engineering and math (“STEM“), Ms. Agrawal’s success in structural engineering is intended to serve as a persuasive example for others. She writes that structural engineering is still a profession mostly practiced by men and believes that more women should consider becoming a part of it. Her advancement in this field should provide a high degree of inspiration for this intended audience as well as many other readers.

Of a truly great event very well told here, Ms. Agrawal recounts the remarkable story of her personal hero, Emily Warren Roebling. When the Brooklyn Bridge was being built (1869-1883), her husband, Washington Roebling, was the chief engineer on this project. When he became ill, his wife took over and become the de facto chief engineer. She delivered critical information from her husband to his assistants on site. Moreover, she mastered all aspects of the design, physics, materials and management of the bridge and is credited with having become the essential individual in getting this supremely complicated undertaking completed. Her devotion to this endeavor was simply extraordinary. Ms. Agrawal eloquently expresses her great admiration for Emily Roebling and why she was an inspiration for her own career path.

Second, she emphasizes the importance of being well prepared for all possible contingencies in her work. There are a multitude of variables to all be taken into account when building anything and it is imperative that structural engineers be able to anticipate, assess, test and decide how to definitively deal with all of them. Such unwavering diligence and exactitude is clearly applicable to many other jobs and professions. Ms. Agrawal effectively makes her case for comprehensive planning and precision at several key junctures in her writing.

Third and equally impressive is Ms. Agrawal’s boundless enthusiasm for her work. She so enjoys and believes in what she is doing that any reader in any field can benefit from from her example.  Granted that everyone’s work situation is different and often changeable can present a range of challenges. However, when someone like the author can sustain such genuine passion for the work she is doing, reading Built may well have the added benefit of providing you with a more positive perspective on your own employment as well that of others.

As proof, a new condominium was recently being built along one of my daily walking routes. I happened to be reading Built towards the end of its construction. After finishing the book, whenever I passed this site again, I saw all of the workers and their completed building with a newly enhanced understanding and admiration of it all.  I would never have previously had this appreciation without first relying upon this book’s, well, very solid foundation.

 


In a very different and more virtual context, a method for “building” a structure in one’s own mind as form of memory enhancement device whereby someone can then fill the “rooms” with many items that can later be retrieved and thus recalled at will was first devised in the 16th century.  This story was among the many subjects of a fascinating historical account entitled The Memory Palace of Matteo Ricci, by Jonathan D. Spence (Penguin Books, 1985).


1.   See the September 1, 2015 Subway Fold post entitled A Thrilling Visit to the New One World Observatory at the Top of the World Trade Center for photos and descriptions of the amazing views from the One World Observatory very top of 1WTC.

2.  See these 10 Subway Fold posts on other recent developments in material science including, among others, such way cool stuff as Q-Carbon, self-healing concrete (also mentioned in Built at pages 106 -107), and metamaterials.