Engineering Ethics In Practice

🤖 WHEN MACHINES LEARN TO HEAL For decades, we built machines to extract, to dig, to mine, to accelerate. But the first time I saw a robot cleaning the ocean, I felt something I’d never associated with technology before: redemption. It wasn’t designed to win. It was designed to give back. And that’s when I realized — we might be entering an age where machines stop competing with us… and start repairing what we broke. Every great technology forces a deeper question: Does it serve growth, or does it serve life? These new ocean-cleaning systems quietly answer that question: → They detect and collect debris before it reaches coral habitats. → They separate plastics and metals without harming marine life. → They run on renewable energy, working continuously to restore what we’ve damaged. It’s not just innovation. It’s intention — made visible. For most of history, progress meant dominance. We measured success by control — over time, matter, and motion. But this new era of engineering is different. The smartest machines won’t compete — they’ll coexist. The real frontier isn’t power — it’s responsibility. The Solution: Restorative Design Thinking If you’re building, leading, or innovating — this is the mindset shift that matters: ✅ Ask how your product can return value to the world that sustains it. ✅ Measure success by net positive outcomes, not just efficiency. ✅ Build systems that get smarter at healing, not just scaling. Because the true power of technology isn’t in automation — it’s in atonement. If we can build machines that heal our oceans, Maybe we can learn to build systems that heal ourselves too. So here’s what I keep wondering — 👉 Will the future of innovation be defined by how much we create, or by how much we restore? #Innovation #Sustainability #AI #ClimateTech #FutureThinking #Leadership #OceanCleanup

✈️ 🇪🇺 « Trustworthy AI in Defence »: The European Way 🗞️The European Defence Agency’s White Paper is out! At a time when global powers are racing to develop & deploy AI-enabled defence capabilities,the European way =tech innovation + ethical responsibility, operational effectiveness + legal compliance, strategic autonomy + respect for human dignity & democratic values. 🔹AI in defence as legally compliant, ethically sound, technically robust, societally acceptable. 1 🤝🏻Principles of Trustworthiness 🔹foundational principles for trustworthy AI in defence: accountability, reliability, transparency, explainability, fairness, privacy, human oversight. Not optional but integral to the legitimacy of AI systems used by European armed forces. 2. Ethical and Legal Compliance 🔹 Europe’s commitment is to effective military capabilities but also to a rules-based international order. The EU explicitly rejects the idea that technological advancement justifies the erosion of ethical norms. 🔹 importance of ethical review mechanisms, institutional safeguards, alignment with #EU legal frameworks=a legal-ethical backbone ensuring trustworthiness is a practical requirement embedded into every phase of AI development/deployment. 3. Risk Assessment & Mitigation 🔹 EU’s precautionary principle=>rigorous & ongoing risk assessments of AI systems, incl. risks related to technical failures, misuse, bias, and unintended escalation in operational contexts. To anticipate harm before it materializes and equip systems with built-in safeguards 🔹Risk mitigation not only a technical task but an ethical &strategic imperative in high-stakes domains (targeting, threat detection, autonomous mobility). 4. 👁️Human Oversight & Control 🔹The EU rejects fully autonomous weapon systems operating without human intervention in critical functions like the use of force. The Paper calls for clear human-in-the-loop models, where operators retain oversight, intervention capability, and accountability. = safeguards democratic accountability & operational reliability, ensuring no algorithm makes life-and-death decisions. 5. Transparency and Explainability 🔹transparent #AI systems, not black-box models : decision-making processes understandable by users & traceable by designers. Key for after-action reviews, audits, & compliance. Strong stance on explainability 6. European Cooperation &Standardization 🔹Enhanced cooperation and harmonization in defence AI : shared definitions, frameworks to ensure interoperability, avoid duplication, promote a common culture of responsibility. 🔹 joint work on certification processes, training, testing environments 7. Continuous Monitoring and Evaluation 🔹ongoing monitoring, validation, recalibration of AI tools throughout their deployment. «trustworthiness must be maintained, not assumed » =The European way: lead not by imitating others’ race toward automation at any cost, but by demonstrating security, innovation, and values can go hand in hand

Some obvious and not so obvious challenges of being a Principal Engineer   Paradox of Belonging: You are part of all teams, yet you are part of none. The role can be surprisingly isolating - you're connected to everyone but deeply anchored nowhere. It is important to find the right circles of trust, peer mentorship and individuals you can share your challenges with.   Freedom-Responsibility Paradox: You enjoy significant autonomy in being able to choose what to work on, however there is an implicit expectation and accountability for resounding impact. You constantly find yourself needing to validate if you are truly solving the right problems. The solve is to create an impact framework to assess your work's potential value while maintaining consistent feedback loops to validate not just progress but also the choices. The freedom isn't about doing what you want; it's about taking ownership of finding the highest leverage problems to solve.   Bandwidth Challenges: It is easy to become a "social resource" - the person in every meeting, involved in every key decision and helping everyone who asks. This leads to burnout from context switching, disconnect from hands-on tech and diluted impact across many initiatives. The trick is to transform from being a reactive social resource into a strategic force multiplier by establishing clear engagement frameworks, scalable solutions and protecting your bandwidth for high-leverage activities.   Being Truly Present: You find yourself physically present in one meeting while your mind is already racing ahead to the next three. This primarily stems from over-scheduled calendars with high-stakes decisions being made across multiple domains, leading to reduced effectiveness and lower quality decision making. You therefore need to create space between commitments and develop systems enabling full presence in fewer, more impactful discussions. The goal isn't to be in every meeting, it's to be fully present in the right ones.   Perfection Trap: As a responsible engineer, one always seeks to do a thorough analysis and exhaustive trade-off evaluation to make high quality decisions. However as PEs working on broader, ambiguous problems, you realize perfect decisions often compete with good enough decisions that offer progress and unblock teams. Accept that good decisions now is better than perfect decisions later. Authority Paradox: Contrary to perception, PEs possess little to no authority by default. While often being tasked with broader, cross functional initiatives, PEs lack the traditional levers of control. Unlike people managers, PEs cannot simply delegate tasks or make direct assignments. Instead, our effectiveness hinges on our ability to inspire, persuade and align diverse teams towards a common goal. PEs can't simply issue orders or delegate based on hierarchical authority. Rather, we must earn respect through a combination of technical expertise, strategic vision, and most crucially, trust.  

Instead of treating water as a resource that living ecosystems can absorb, we spend billions treating it as a liability to expel through rigid concrete. Modern civil engineering frequently relies on isolated and linear models that fracture under the weight of climate volatility. A natural wetland operates as a masterful feat of evolutionary design by seamlessly integrating flood mitigation, carbon sequestration, and groundwater recharge into a single autonomous mechanism. True systemic resilience demands a structural shift in how we perceive progress and capital allocation. We must stop viewing poured concrete as the default answer to urban planning challenges and we must recognise ecological preservation as our highest return on investment. Protecting the natural architecture that already regulates our environment remains the most sophisticated and economically sound infrastructure choice we can make.

How and to what extent can ethical theories guide the design of AI systems? This is the question I'd like to tackle in this week's #sundAIreads. The reading I chose for this is "Ethics of AI: Toward a Design for Values Approach" by Stefan Buijsman, Michael Klenk, and jeroen van den hoven from the Delft University of Technology. It's a chapter in The Cambridge Handbook of the Law, Ethics and Policy of Artificial Intelligence, which is available open access here: https://lnkd.in/dmP7hBnJ. The authors argue that familiar ethical theories such as virtue ethics ("what character traits should I cultivate?"), deontology ("which moral principles should I follow?"), and consequentialism ("what actions maximize wellbeing?") are necessary, but insufficient to guide the responsible development and deployment of #AI systems. Instead the authors advocate for a #design approach to AI ethics, which entails identifying relevant values, embedding them in AI systems, and continuously evaluating whether and to what extent these efforts were successful. Of course, this is easier said than done. Why? Because: 1️⃣ Values come with trade-offs, e.g., #privacy versus #security or #usability. 2️⃣ Values can change, both in terms of what they mean and how important they are to people, e.g., #sustainability. 3️⃣ AI systems are socio-technical systems, i.e., AI ethics is "just as much about the people interacting with AI and the institutions and norms in which AI is employed." These challenges can be addressed by: ✅ Making trade-offs between values explicit and either trying to resolve them or at least documenting the reasoning behind why one value was chosen over the other. ✅ Designing for "adaptability, flexibility and robustness" to account for changing values over time. ✅ Considering the environment in which AI systems will be deployed, including not only the people who will use AI systems, but also those affected by their use. I first encountered the values-by-design literature during my postgraduate studies with Helen Nissenbaum at the NYU Steinhardt Department of Media, Culture, and Communication and have been a huge fan ever since. For an even more hands-on approach to translating ethical values into technical design, I recommend checking out Dr. Niina Zuber, Severin Kacianka, Alexander Pretschner, and Julian Nida-Rümelin's Ethics in Agile Software Development (EDAP) project at the Bayerisches Forschungsinstitut für Digitale Transformation (bidt) (https://lnkd.in/dNiBUxBF) and Dr Lachlan Urquhart's Moral-IT Deck (https://lnkd.in/d9J2WQNi).

A reading recommendation for this week is this white paper developed by the IEEE SA Research Group on Issues of Autonomy and AI in Defense Systems which presents 𝗔 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 𝗳𝗼𝗿 𝗛𝘂𝗺𝗮𝗻 𝗗𝗲𝗰𝗶𝘀𝗶𝗼𝗻 𝗠𝗮𝗸𝗶𝗻𝗴 𝗧𝗵𝗿𝗼𝘂𝗴𝗵 𝘁𝗵𝗲 𝗟𝗶𝗳𝗲𝗰𝘆𝗰𝗹𝗲 𝗼𝗳 𝗔𝘂𝘁𝗼𝗻𝗼𝗺𝗼𝘂𝘀 𝗮𝗻𝗱 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝘁 𝗦𝘆𝘀𝘁𝗲𝗺𝘀 𝗶𝗻 𝗗𝗲𝗳𝗲𝗻𝘀𝗲 𝗔𝗽𝗽𝗹𝗶𝗰𝗮𝘁𝗶𝗼𝗻𝘀. The framework addresses stakeholders involved in policy, design, testing, procurement, decision-making, deployment, and evaluation processes related to autonomous and intelligent systems (AIS), in public-sector decisions about defence applications. The framework supports stakeholders in raising and offering first steps towards applying existing sets of broad ethical principles and standards in the context of AIS, including but not limited to those associated with Article 36 of Additional Protocol I to the Geneva Conventions. The white paper was developed by a number of great authors including Dr Ingvild Bode, Ariel Conn and Rain Liivoja among many others. I have included the report below for easy access. You can also freely access and download the report here: https://lnkd.in/gEqbraya . . . . #ReadingRecommendation #IEEE #AutonomousSystems #IntelligentSystems #HumanDecisionMaking #DefenseApplications #EthicalFrameworks #PolicyDevelopment #StakeholderEngagement #TechnologyInDefense #AIethics #ResearchInsights #InnovationInDefense #PublicSector #DefensePolicy

🔍 Everyone’s discussing what AI agents are capable of—but few are addressing the potential pitfalls. IBM’s AI Ethics Board has just released a report that shifts the conversation. Instead of just highlighting what AI agents can achieve, it confronts the critical risks they pose. Unlike traditional AI models that generate content, AI agents act—they make decisions, take actions, and influence outcomes. This autonomy makes them powerful but also increases the risks they bring. ---------------------------- 📄 Key risks outlined in the report: 🚨 Opaque decision-making – AI agents often operate as black boxes, making it difficult to understand their reasoning. 👁️ Reduced human oversight – Their autonomy can limit real-time monitoring and intervention. 🎯 Misaligned goals – AI agents may confidently act in ways that deviate from human intentions or ethical values. ⚠️ Error propagation – Mistakes in one step can create a domino effect, leading to cascading failures. 🔍 Misinformation risks – Agents can generate and act upon incorrect or misleading data. 🔓 Security concerns – Vulnerabilities like prompt injection can be exploited for harmful purposes. ⚖️ Bias amplification – Without safeguards, AI can reinforce existing prejudices on a larger scale. 🧠 Lack of moral reasoning – Agents struggle with complex ethical decisions and context-based judgment. 🌍 Broader societal impact – Issues like job displacement, trust erosion, and misuse in sensitive fields must be addressed. ---------------------------- 🛠️ How do we mitigate these risks? ✔️ Keep humans in the loop – AI should support decision-making, not replace it. ✔️ Prioritize transparency – Systems should be built for observability, not just optimized for results. ✔️ Set clear guardrails – Constraints should go beyond prompt engineering to ensure responsible behavior. ✔️ Govern AI responsibly – Ethical considerations like fairness, accountability, and alignment with human intent must be embedded into the system. As AI agents continue evolving, one thing is clear: their challenges aren’t just technical—they're also ethical and regulatory. Responsible AI isn’t just about what AI can do but also about what it should be allowed to do. ---------------------------- Thoughts? Let’s discuss! 💡 Sarveshwaran Rajagopal

I have pointed to the challenges of multi-sided agent marketplaces. There is a massive opportunity to establish custom platforms for commercial agent interaction. Agent Exchange (AEX) provides an interesting starting point. A generalized agent market is unlikely to emerge for some time (though the potential value is immense). Consider your industry and what the dynamics of a useful agent marketplace might be. Who will take that opportunity? Below are some of the key ideas and insights in the recent paper "Agent Exchange: Shaping the Future of AI Agent Economics". 🧠 Agents become economic actors—not just tools. LLM-based agents are evolving into autonomous economic participants that can make strategic decisions, form coalitions, and bid for tasks with minimal human input. This transition underpins the rise of an “agent-centric economy,” where decentralized coordination replaces top-down control. 💸 Enhanced Auction structure provides balanced performance across real-world conditions. The authors compared five allocation methods—greedy, random, cost-optimal, capability-first, and their proposed Enhanced Auction. The Enhanced Auction was selected because it consistently delivered the best trade-off between cost efficiency, adaptability, and robustness across varying task complexities and market liquidity. It uses a weighted scoring system that factors in capability match, expected quality, cost, and timing, outperforming the narrower focus of the alternatives. ⚖️ Shapley values ensure fair credit for multi-agent collaboration. To allocate rewards fairly, the system uses the Shapley value—a game theory method that calculates each agent’s marginal contribution by averaging their added value across all possible team combinations. This approach captures interdependencies and avoids over- or under-rewarding agents in collaborative tasks. 🛠️ Adaptive coordination models for different markets. AEX supports four auction-assignment configurations—from full auctions to direct assignments—mirroring real-world systems like consulting services or cloud computing. This adaptability ensures efficient resource allocation under varying market liquidity. 💼 Specialized agents outperform large models in niche tasks. Despite the power of foundation models, the paper argues they are economically inefficient for many tasks. Specialized agents deliver better cost-performance in routine, domain-specific contexts due to lower inference costs and more targeted capabilities. AEX’s simulation shows promising performance under controlled assumptions, including static capabilities and perfect information. This work is just a starting point, as any real-world platform would need to deal with dynamic agent behaviors, strategic manipulation, and the realities of deployment, participant onboarding etc.

🛡️ Anthropic just raised the bar for AI safety with Claude Opus 4 and Sonnet 4. As builders in the AI space, we often focus on pushing capabilities forward. But Anthropic's activation of ASL-3 (AI Safety Level 3) protections reminds us that responsible innovation means scaling safety alongside capability. Key takeaways that matter for our industry:- - Proactive, not reactive:- They've implemented these measures before definitively determining they're needed. In a field moving at breakneck speed, this precautionary approach sets a new standard. - Technical depth meets real-world impact:- Over 100 security controls, Constitutional Classifiers monitoring in real-time, and innovative egress bandwidth controls to prevent model weight theft. This isn't security theater - it's engineering excellence applied to AI safety. - Narrow focus, broad implications:- While specifically targeting CBRN weapons risks, their approach demonstrates how we can build powerful AI systems without compromising on safety. The deployment measures are surgical - preventing dangerous misuse without hampering legitimate research and innovation. What excites me most? Their commitment to transparency. Publishing detailed reports and actively inviting industry collaboration shows that AI safety isn't a competitive advantage - it's a collective responsibility. For those of us building agentic AI solutions, this is a masterclass in responsible scaling. As our AI agents become more capable, we need frameworks that grow with them. The message is clear:- The future of AI isn't just about what we can build, but how thoughtfully we build it. What's your take on balancing innovation speed with safety measures in AI development? #AI #AISafety #ResponsibleAI #Innovation #TechLeadership #Claude #Anthropic #AgenticAI

Data privacy and ethics must be a part of data strategies to set up for AI. Alignment and transparency are the most effective solutions. Both must be part of product design from day 1. Myths: Customers won’t share data if we’re transparent about how we gather it, and aligning with customer intent means less revenue. Instacart customers search for milk and see an ad for milk. Ads are more effective when they are closer to a customer’s intent to buy. Instacart charges more, so the app isn’t flooded with ads. SAP added a data gathering opt-in clause to its contracts. Over 25,000 customers opted in. The anonymized data trained models that improved the platform’s features. Customers benefit, and SAP attracts new customers with AI-supported features. I’ve seen the benefits first-hand working on data and AI products. I use a recruiting app project as an example in my courses. We gathered data about the resumes recruiters selected for phone interviews and those they rejected. Rerunning the matching after 5 select/reject examples made immediate improvements to the candidate ranking results. They asked for more transparency into the terms used for matching, and we showed them everything. We introduced the ability to reject terms or add their own. The 2nd pass matches improved dramatically. We got training data to make the models better out of the box, and they were able to find high-quality candidates faster. Alignment and transparency are core tenets of data strategy and are the foundations of an ethical AI strategy. #DataStrategy #AIStrategy #DataScience #Ethics #DataEngineering