Black box vs. white box AI – how transparent should city AIs be?

Building design
an-aerial-view-of-a-city-JSRekW1fRfY

Aerial view of a Swiss city, captured by photographer Ivan Louis

Artificial intelligence in urban planning is no longer a topic of the future – but how much can we really trust its decisions? Between black box and white box AI, the question is whether urban algorithms will become a tool for democratic urban development or an opaque power entity. Time to take the debate on transparency, explainability and governance of urban AIs to the next level.

  • Differences between black box and white box AI: what is behind the terms?
  • Why transparency in urban AI is so crucial for planners, administrators and the public.
  • How algorithmic decision-making influences urban development, participation and governance.
  • Risks and side effects of non-transparent AI models: from bias to loss of control.
  • Legal and ethical framework conditions for the use of AI in German, Austrian and Swiss cities.
  • Best practices: How cities are using whitebox AI to implement sustainable, traceable planning.
  • Challenges in opening up complex AI systems and communicating the technical background.
  • Opportunities for participation, quality assurance and innovation culture through explainable algorithms.
  • Concrete recommendations for planners, administrations and developers when dealing with urban AI.

Black box vs. white box AI: What does transparency mean in urban planning?

Few topics are currently polarizing experts as much as the question of the transparency of AI systems in urban planning. While algorithms and machine learning have become indispensable tools for many planners, the basic problem often remains unresolved: How can we understand how an AI arrives at its results? A distinction is made here between so-called black-box and white-box AIs – two terms that reveal more about how the systems work, how they are controlled and ultimately also about trust in them than is apparent at first glance.

Blackbox AI refers to applications whose internal logic and decision-making processes are largely opaque to users. Deep learning models, for example – including neural networks such as those used in image or traffic analysis – deliver impressively precise forecasts, but do not disclose their decision-making process. As a result, users, planners and often the developers themselves are faced with a conundrum when it comes to explaining the machine’s conclusions. In a discipline in which legal certainty, traceability and public participation are central pillars, this can quickly become a problem.

Whitebox AI stands in contrast to this. Here, the decision-making processes are comprehensible, logically explained and, in the best case, even documented. Decision trees, rule-based systems or even transparent linear models belong to this type. They are less “magical”, but also less error-prone in terms of unnoticed distortions or algorithmic bias. Especially in the context of urban digital twins, traffic models or climate analyses, this transparency can become a decisive quality and acceptance factor.

The debate is by no means purely academic. In Germany, Austria and Switzerland, high demands are placed on the traceability and rule of law of administrative decisions. However, the more artificial intelligence is integrated into the planning and management of cities, the more pressing the question becomes: who actually understands what the machine decides – and why?

Transparency is therefore not just a technical feature, but an elementary governance feature. It determines whether AI systems in urban development are perceived as a tool for democratic design or as a black box of power. There is a lot at stake: trust, legitimacy and ultimately the future viability of urban innovations.

Why transparency is non-negotiable: governance, participation and responsibility

Urban planning is always a political act – and politics thrives on publicity, discourse and accountability. This is precisely where the dilemma of non-transparent AI applications becomes apparent: They can make decision-making processes more efficient, but at the same time they can also de-democratize them if their results are not comprehensible. This starts with the question of how to optimize traffic flows or simulate development options, and ends with the prioritization of infrastructure investments or the assessment of climate risks.

Black box AIs can become a kind of technocratic authority – with enormous implications for the governance of urban systems. Those who do not understand the logic behind the recommendations can neither critically question nor correct them. This opens the door to algorithmic distortions, unnoticed error chains or even systematic discrimination. Experts are already warning that AI systems reinforce social inequalities if training data or model assumptions are not carefully checked.

But the risks go even further: non-transparent algorithms make public participation more difficult and thus weaken the democratic foundation of urban development. Citizens lose the opportunity to make a well-founded contribution if the basis for decision-making is not open to them. Particularly in the case of controversial projects – such as traffic calming in city centers or the conversion of land – it is crucial that all stakeholders understand and can discuss the “rules of the game” of AI models.

Transparency is therefore not just a question of technical elegance, but a central element of accountability and participation. It enables sources of error to be identified, model assumptions to be questioned and alternative scenarios to be developed. This is the only way to prevent urban AIs from becoming black boxes that exercise power without control.

In this context, responsibility also means that administrations, planners and developers work together to find ways of openly documenting and continuously evaluating AI systems. The disclosure of training data, model architectures and result evaluations is not a chore, but an imperative of modern, responsible urban development.

Legal, ethical and technical challenges: The hurdles for whitebox AI

As nice as the ideal of whitebox AI sounds – in practice, getting there is anything but trivial. Complex technical requirements, legal uncertainties and ethical dilemmas often stand in the way of a consistent opening. In Germany, Austria and Switzerland in particular, the requirements for data protection, file clarity and traceability are extremely high – a consequence of established administrative traditions, but also an expression of social expectations for transparency and fairness.

From a technical perspective, many modern AI systems are so complex that it is almost impossible for laypersons – and often experts – to fully disclose the internal processes. Deep learning models, for example, consist of millions of parameters whose interactions are difficult to explain. Explainable AI (XAI) methods attempt to at least partially open up this black box by visualizing results or highlighting the most important influencing factors. However, these approaches also have their limits: A highly optimized model cannot always be translated cleanly into human language.

From a legal perspective, the question arises as to how much transparency is actually required – and in what form it must be provided. The General Data Protection Regulation (GDPR), for example, requires that automated decisions are comprehensible and that data subjects have the right to an explanation. In practice, however, it often remains unclear how detailed this declaration must be and how it can be implemented at all in complex AI systems. There are also questions of liability: who is responsible if an AI model makes incorrect recommendations – the developer, the user or the city administration?

Ethical considerations also play a central role. AI systems can – consciously or unconsciously – reproduce social prejudices, for example when training data reflects existing inequalities. Those who do not make the models transparent can hardly control or correct these effects. At the same time, there is a risk that full disclosure could compromise sensitive data or jeopardize business secrets, for example if commercial providers of urban AI are involved.

It is a balancing act: between openness and security, between explainability and speed of innovation. Cities that follow this path must be prepared for a continuous learning process – and for a new culture of interdisciplinary collaboration between planners, technicians, lawyers and ethicists.

Best practices and opportunities: How whitebox AI is revolutionizing urban planning

Despite all the challenges, there are successful examples that show how whitebox AI is opening up new perspectives for urban development. Cities such as Helsinki, Rotterdam and Vienna are already relying on explainable algorithms to make participation processes, climate analyses and traffic models comprehensible. This does not happen overnight, but requires targeted strategies, investments and a clear governance structure.

A key element of successful whitebox AI is the open documentation of all model assumptions, data sources and calculation steps. This allows citizens to understand the basis on which urban priorities are set and experts to simulate alternative scenarios. Open source approaches and open interfaces (open urban platforms) make it easier to integrate new data sources and involve external stakeholders. This creates a new form of collaborative urban development in which different perspectives and specialist disciplines come into play.

Another recipe for success is the close integration of technology and participation. Whitebox AI is ideal for visualizing complex processes and making them understandable for laypeople. For example, different development or traffic variants can be simulated in real time and discussed together – a new form of digital citizen participation that combines professional quality and social acceptance.

More and more cities are also relying on transparent algorithms for quality assurance. Sources of error can be identified more easily, distortions are recognized more quickly and model assumptions can be continuously adjusted. This not only strengthens trust in the systems, but also the culture of innovation within the administration. The willingness to test and further develop new tools increases if control over the decision-making logic is guaranteed.

Finally, whitebox AI also opens up new opportunities for research and teaching. Open models and data make it possible to develop new questions, promote interdisciplinary cooperation and intensify the transfer of knowledge between science, administration and practice. Those who rely on explainable algorithms today will secure pole position for the urban development of tomorrow.

Conclusion: The future of urban AI will be decided by transparency

The discussion about black box and white box AI is much more than a technical debate – it is a litmus test for the democratic maturity and innovative strength of urban planning in German-speaking countries. Anyone who leaves the control of the city to digital twins, traffic models or climate simulations must ensure that these systems remain comprehensible, explainable and verifiable. This is the only way to ensure long-term trust, legitimacy and quality in planning.

Black box AI may appear faster or more powerful in some cases, but it harbors considerable risks: from algorithmic distortion and loss of control to the weakening of democratic participation. Whitebox AI is not a panacea, but it creates the conditions for urban algorithms to become a tool for responsible, participatory and sustainable urban development. It requires courage, investment and staying power – but it pays off when it comes to anchoring innovative solutions in society.

For planners, administrators and developers, transparency is not a luxury, but the ticket to the future of the city. Those who set the right course now can not only demonstrate technological excellence, but also establish a new culture of cooperation and quality assurance. The question is not whether urban AI systems will come – but how we shape them. The answer will determine the future of our cities.

POTREBBE INTERESSARTI ANCHE

Pritzker Prize, this time again as a star award

Building design

Arata Isozaki, that is. This year. Born in 1931, the architect, urban planner and theorist was awarded the 2019 Pritzker Prize. And reactions are mixed.

Arata Isozaki, that is. This year. Born in 1931, the architect, urban planner and theorist has been awarded the Pritzker Prize 2019. And reactions are mixed. Once again. Some are surprised that the man, whose well-known buildings (such as the Museum of Contemporary Art in Los Angeles or the Olympic Stadium in Barcelona) have all been standing for a while, had not received the major prize long ago. Others find the choice sensible; but some also find it rather unnecessary – why honor someone whose work is nearing its end, why not rather choose someone for whose (or whose) work the award can be a driving force? My colleagues in the editorial team reacted rather bored.

I think the Pritzker jury needs to make up its mind when it comes to award policy. At the moment, too many different motives seem to exist in parallel. Is this an award for a significant life’s work? For interesting offices that may be the future? For relevant political approaches? Each direction on its own is possible. All together is probably not.

And incidentally, I stand by the opinion I expressed two years ago: the Pritzker Prize is awarded too often. Every three, or even better, every four years would be a more sensible frequency.

Nevertheless, this should not go under: Congratulations, Arata Isozaki.

The visualization shows the town hall square in Oberwart with trees and a fog fountain in the middle where children are playing.

3:0 Landscape Architecture create a green promenade in Oberwart - and this is what it could look like. Visualization: 3:0 Landscape Architecture

Oberwart is getting a green promenade designed by 3:0 Landschaftsarchitektur. The Vienna-based firm won the architectural competition for the redesign of Oberwart’s town center.

More greenery for Oberwart town center

The redesign of Oberwart town center began back in summer 2021. At that time, the city launched a citizen participation project. The aim was to find out the needs of the population. The guiding principle behind the project was the intention to transform Oberwart into a more liveable place. In addition, the city was to become more forward-looking and climate-friendly. The participation process in March 2022 was therefore followed by an open architectural competition. Eight projects were submitted in the process. The winning office has now been chosen. 3:0 Landscape Architecture from Vienna won over the nine-member jury. Their vision for the new Oberwart town center meets the wishes of the citizens. For example, they had called for more greenery and less traffic in the town center. They also wanted cozy squares with more places to spend time. In addition to the feedback from the participation process, there were also other aspects to consider.

Challenges of the planning task

For example, the design quality of the landscape architecture was a key aspect. However, the designs also had to respond to the traffic conditions. The primary aim was to reduce traffic in the city center. At the same time, the needs of the local businesses had to be taken into account. 3:0 Landscape Architecture succeeded in taking all these aspects into account in their planning – by developing the Oberwart city promenade. This extends as a green ribbon for everyone from Rathausplatz to the Südtiroler Siedlung. The planting of new trees, water elements and plenty of seating provide an ecological and aesthetic upgrade. Furthermore, different spatial characters are created.

One ribbon – three characters

A front garden promenade is being created in front of the South Tyrolean settlement. It will serve as a haven of peace in the development. In addition to play and sports equipment that appeals to young and old alike, magnificent shrub beds and flowering meadows are also being created here. The so-called “twin gardens” are planted with fruit trees and create impressive flowering aspects throughout the year thanks to their biodiversity. Opposite the entrance to the town in front of the South Tyrolean settlement is the town hall square. Here, a more representative character is created, which pays tribute to the buildings of the town hall and district court. The spacious center of the square is designed to be flexible. It offers space for small and large events. The space is structured by two stringent tree grids. In addition to the shade cast by the trees, the new fog fountain also helps to cool the urban space. It also serves as a design accent that invites people to play in the swathes. The market promenade stretches between the two squares. In future, residents will be able to take a relaxed stroll under the planned avenue of trees. Seating areas invite people to linger.

Oberwart becomes climate-ready

Mayor Georg Rosner is highly satisfied with the jury’s decision. He is also certain that this will initiate a forward-looking process: With the plans presented today, we are taking an important step towards redesigning the town center. In 3:0 Landscape Architecture, the city has found an experienced partner in the climate-sensitive transformation of squares and cities. In Oberwart, for example, 3:0 Landscape Architecture is now planning to plant 200 trees according to the sponge city principle. The aim is to ensure that the city center is also prepared for prolonged periods of heat. Furthermore, surfaces open to evaporation will be laid in light shades of color. These are used for rainwater management. They also counteract heat storage. The climate-friendly promenade will thus become a green backbone for Oberwart, which will have a lasting positive impact on the city.

Steps towards realization

Until the project can be realized in 2024, the negotiation process is still pending. Among other things, it will be important to determine which preparatory and accompanying measures are necessary. By communicating with all parties involved in advance, the construction work should not interfere with business activities. Once all agreements have been made, the municipal council will decide to commission the work. And thus the green light for the realization of the new Oberwart city promenade.

The cooling of the square is directly considered by 3:0 Landscape Architecture. A retrofit that was necessary for Turbinenplatz in Zurich. A fog cloud is currently installed there as an immediate measure to cool the square in the medium term. Read here how this pilot project works: Alto Zürrus