Impact of IEEE Computer Society
in Advancing Software Engineering and
Emerging Technologies
Hironori Washizaki
Waseda University, Professor
IEEE Computer Society 2025 President
ICCA, December 18th 2024
1
Waseda University, Tokyo, Japan
• A top institution of higher education
– 50,000 students in 13 undergraduate and 21
postgraduate schools
2
Japanese University Life https://www.youtube.com/watch?v=qjTqeejCWY0
• Has hosted many international software
engineering and computing conferences
– SPLC 2013, IEEE ICST 2017, IEEE COMPSAC 2018
(partially), ACM VRST 2018, ICIAM 2023, IEEE
VCIP 2024, IEEE CSEE&T 2023
• Strong software engineering team
– Prof. Hironori Washizaki: IPSJ-SIGSE
2021-2024 Chair, IEEE Computer Society
2025 President, SWEBOK Guide V4
Editor, General/PC Chair of CSEE&T, ICST
and APSEC, PC member of FSE
– Prof. Naoyasu Ubayashi: IPSJ-SIGSE
2013-2016 Chair, General/PC Chair of
MODELS, MODULARITY/AOSD, APRES
and APSEC
https://commons.wikimedia.org/wiki/Category:People_associated_with_Wa
seda_University?uselang=ja#/media/File:Okuma_lecture_hall_Waseda_Univ
ersity_2007-01.jpg
IEEE Computer Society: Empowering Computer Science and Engineering
Professionals to Fuel Continued Advancement
3
4
Megatrends in IEEE Future Direction 2023 and IEEE-CS Technology Predictions 2024
IEEE CS Technology Prediction Team (Chair: Dejan Milojicic) https://www.computer.org/resources/2024-top-technology-predictions
Next Gen AI
Generative AI
applications
Metaverse
Low power AI
accelerator
Knowledge Area
Topic Topic
Reference
Material
Body of Knowledge Skills Competencies Jobs / Roles
SWEBOK
Software Engineering Professional Certifications
SWECOM
EITBOK
Learning courses
5
Guide to the Software Engineering Body of Knowledge (SWEBOK)
https://www.computer.org/education/bodies-of-knowledge/software-engineering
• Guiding researchers and practitioners to identify and have
common understanding on “generally-accepted-knowledge”
in software engineering
• Foundations for certifications and educational curriculum
• ‘01 v1, ‘04 v2, ‘05 ISO adoption, ‘14 v3, ’24 v4 just published!
5
Mainframe
70’s –
Early 80’s
Late 80’s -
Early 90’s
Late 90’s -
Early 00’s
Late 00’s -
Early 10’s
PC,
Client &
server
Internet
Ubiquitous
computing
Late 10’s -
Early 20’s
IoT,
Big data,
AI
Structured
programming
Waterfall
Formalization
Design
Program
generation
Maturity
Management
Object-oriented
Req. eng.
Modeling
Verification
Reuse
Model-driven
Product-line
Global & open
Value-based
Systems eng.
Agile
Iterative &
incremental
DevOps
Empirical
Data-driven
Continuous
SE and IoT
SE and AI
SWEBOK V1
SWEBOK V2
SWEBOK V3
SWEBOK V4
6
SWEBOK Evolution from V3 to V4
• Modern engineering, practice update, BOK grows and recently developed areas
Requirements
Design
Construction
Testing
Maintenance
Configuration Management
Engineering Management
Process
Models and Methods
Quality
Professional Practice
Economics
Computing Foundations
Mathematical Foundations
Engineering Foundations
Requirements
Architecture
Design
Construction
Testing
Operations
Maintenance
Configuration Management
Engineering Management
Process
Models and Methods
Quality
Security
Professional Practice
Economics
Computing Foundations
Mathematical Foundations
Engineering Foundations
V3 V4
Agile,
DevOps
AI for SE,
SE for AI Software
engineering
AI
AI for SE
SE for AI
7
Example case of ML-based system design
• We wish to identify the type of
instrument for the sound picked up
by the phone and achieve recording
and response according to the type.
• However, the memory and
performance of the phone is
limited, and a large deep learning
model is unlikely to be loaded.
How can we do this?
8
Pretrained
Model
• Let's use Two-stage predictions where a
small model on the phone determines if a
sound is a musical instrument, and a large
model on the cloud classifies the type of
sound only if it is a musical instrument.
• For the large model, we will adopt Transfer
Learning to achieve precise classification.
Machine Learning Design Patterns
(V. Lakshmanan, et al. 2020)
Example of ML design patterns
Two-stage predictions
• Problem: There is a need to maintain the
performance of models that are large and
complex in nature, even when deployed
to edge or distributed devices.
• Solution: The utilization flow is divided
into two phases, with only the simple
phase performed on the edge.
Transfer Learning
• Problem: There is a lack of large data sets
needed to train complex machine learning
models.
• Solution: Some layers of the trained
model are taken out and the weights are
frozen and used in the new model to solve
similar problems without being trained.
9
Machine Learning Design Patterns (V. Lakshmanan, et al. 2020)
AI/ML software engineering patterns
• Architecture and design patterns
– Software Engineering Patterns for ML
applications [SEP4MLA]
– Machine Learning Design Patterns
[MLDP]
• Safety and security patterns
– Safety Case Pattern for ML systems
[Safety]
– Security Argument Patterns for DNN
[Security]
• Responsible AI patterns
– Responsible AI System Design Patterns
[Responsible]
• Development and management
practices
– Lifecycle phase practices [Practice1]
– Issues and development practices
[Practice2]
• Prompt engineering patterns
– Prompt Pattern Catalog [Prompt]
10
[MLDP] V. Lakshmanan, et al., “Machine Learning Design Patterns,” O’Reilly, 2020
[SEP4MLA] H. Washizaki, et al. “Software Engineering Design Patterns for Machine Learning Applications,” IEEE Computer 55(3) 2022, Best Paper Award
[Safety] E. Wozniak, et al., “A Safety Case Pattern for Systems with Machine Learning Components,” SAFECOMP 2020 Workshop
[Security] M. Zeroual, et al., “Security Argument patterns for Deep Neural Network Development,” PLoP 2023
[Responsible] Q. Lu, et al., “Responsible-AI-by-Design: a Pattern Collection for Designing Responsible AI Systems,” IEEE Software, 2023
[Practice1] M. S. Rahman, et al., “Machine Learning Application Development: Practitioners’ Insights,” Software Quality Journal, 31, 2023.
[Practice2] Y. Watanabe, et al., “Preliminary Literature Review of Machine Learning System Development Practices,” COMPSAC 2021 Fast Abstract
[Prompt] J, White, et al., “A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT,” arXiv 2302.11382, 2023
Business
Concerns
System
Concerns
Software
Concerns
Traditional
Software
Concerns
ML Software
Concerns
Costs
Revenues
Stakeholders
Integration
Safety
ML
performance
Data Quality
Model
architecture
Reliability
Experimentative
Definitive
11
How to address multiple aspects in traceable
and consistent way?
=> Metamodel-based multi-view modeling
How to align different
natures together?
=> Pipeline integration
and MLOps
Responsible AI
patterns
ML patterns
ML Safety and
security
patterns
ML architecture
and design patterns
How to incorporate ML patterns
into development?
=> Application with configuration
Multi-view modeling for ML systems [SQJ’24]
ML Canvas
AI Project Canvas Safety Case
Architectural Diagram (SysML) KAOS Goal Model
STAMP/STPA
Value
MLOps Architecture Goals
Safety
Argumentation
Jati H. Husen, Hironori Washizaki, Jomphon Runpakprakun, Nobukazu Yoshioka, Hnin Thandar Tun, Yoshiaki Fukazawa, Hironori Takeuchi, “Integrated Multi-view Modeling for
Reliable Machine Learning-Intensive Software Engineering,” Software Quality Journal, Vol. 32, pp. 1239–1285, Springer-Nature, 2024.
12
Metamodel for consistency and traceability [ICEBE’23][FGCS’24]
ML Canvas
AI Project Canvas
Safety Case
KAOS Goal Model
STAMP/STPA
Architecture (SysML)
ML workflow
pipeline
13
Hironori Takeuchi, Jati H. Husen, Hnin Thandar Tun, Hironori Washizaki and Nobukazu Yoshioka, “Enterprise Architecture-based Metamodel for a Holistic Business – IT
Alignment View on Machine Learning Projects,” IEEE International Conference on E-Business Engineering (ICEBE 2023), Best Paper Award
Hironori Takeuchi, Jati H. Husenb, Hnin Thandar Tun, Hironori Washizaki, Nobukazu Yoshioka, “Enterprise Architecture-based Metamodel for Machine Learning Projects and
its Management,” Future Generation Computer Systems, Elsevier, Vol. 161, pp. 135-145, 2024.
ML model repair (fixing)
• Retraining and online learning
– A straightforward method, but time-consuming
and costly
– Possible side effects of performance degradation
• Data augmentation: generation [a], selection
[b], expansion [c], etc.
– Trial and error without directly modifying model
parameters
– Potential vulnerability to adversarial examples
• Direct modification of parameters according
to specific samples
– Correction for specific labels for adversarial
examples [d].
– Finding and correcting impacted areas in failed
data [e].
[a] Generative adversarial nets, NIPS 2014
[b] MODE: automated neural network model debugging via state differential analysis and input selection, ESEC/FSE 2018
[c] Autoaugment: Learning augmentation policies from data, arXiv:1805.09501, 2019
[d] Unlearned Modification of Neural Network Models for Adversarial Examples and Its Evaluation, JSSST 2019
[e] Search Based Repair of Deep Neural Networks, arXiv:1912.12463, 2019
Average of neuron’s
output values for
successful data
Average of neuron’s
output values for
misrecognition data
Neurons
with high
priority for
fixing
14
Example case of image classification
in autonomous driving
City
Highway
AI Project Canvas
ML Canvas
Architecture
Data Skills
Output
Value
proposition
Integration
Stakeholders
Customer
Cost Revenue
How can we develop and revise a system based on
DNNs with acceptable recognition accuracy considering
safety in the city and on the highway?
Jati H. Husen, Hironori Washizaki, Jomphon Runpakprakun, Nobukazu Yoshioka, Hnin Thandar Tun, Yoshiaki Fukazawa, Hironori Takeuchi,
“Integrated Multi-view Modeling for Reliable Machine Learning-Intensive Software Engineering,” Software Quality Journal, Vol. 32, Springer, 2024.
Case of ML m1 m2 m3
Evaluation of classification
Safety Case
Misclassified data Selection for repair
Balanced repair Result of repair
Aggressive repair
Further revision
1. Dataset revision
2. Architecture
revision for
improving images
3. Revisiting
business goals
Misclassified data
STAMP/STPA KAOS Goal Model
16
Jati H. Husen, Hironori Washizaki, Jomphon Runpakprakun, Nobukazu Yoshioka, Hnin Thandar Tun, Yoshiaki Fukazawa, Hironori Takeuchi, “Integrated Multi-view
Modeling for Reliable Machine Learning-Intensive Software Engineering,” Software Quality Journal, Vol. 32, Springer, 2024.
Application of
assurance patterns
Metamodel
ML
evaluation
Visualizing issues
ML
evaluation
Visualizing resolution
OK
OK OK
Failed Failed
OK OK
OK
OK
OK OK OK
[ML.VP1🡨
AI.VP1]
Providereliable
real-timeobject
detectionsystem
fordriving
decisionmakingin
highway(incl.
trafficsign
detectionand
lane/vehicle
detection)
• [ML.DS1]Procured
datasets
• [ML.DS2]Internal
databasefrom
collectionduring
operation
• [ML.DC1]Openand
commercialdatasets
• [ML.DC2]Data
collectedduring
operation(imageand
identificationresult)
•[ML.F1🡨
AI.D1/AI.D3]
Boundingbox
forobject(incl.
othervehicles
orsigns)
•[ML.F2🡨
AI.D2]Ridge
detectionfor
lanedetection
[ML.BM1]
Modelswillbe
developed,
tested,and
deployedtocars
monthly
• [ML.PT1]Input:
imagefromsensors
• [ML.PT2←AI.D]
Output:trafficsigns,
lanemarking,
vehicles,and
pedestrians.
[ML.De1]Use
predictionresults
fordecision-
makinginself-
drivingsystem
[ML.IS1]
Usingtestdata,
achieveveryhigh
recallandhigh
precisionin
followingcondition:
night,rainy,and
generalcondition
Datasetsissplitinto
80:20ratio
[ML.MP1]
Predictionshould
bemadein
batchesreal
time.
[ML.M1]Inputdatamonitoring
[ML.VP1🡨
AI.VP1]
Providereliable
real-timeobject
detectionsystem
fordriving
decisionmakingin
highway(incl.
trafficsign
detectionand
lane/vehicle
detection)
• [ML.DS1]Procured
datasets
• [ML.DS2]Internal
databasefrom
collectionduring
operation
• [ML.DC1]Openand
commercialdatasets
• [ML.DC2]Data
collectedduring
operation(imageand
identificationresult)
•[ML.F1🡨
AI.D1/AI.D3]
Boundingbox
forobject(incl.
othervehicles
orsigns)
•[ML.F2🡨
AI.D2]Ridge
detectionfor
lanedetection
[ML.BM1]
Modelswillbe
developed,
tested,and
deployedtocars
monthly
• [ML.PT1]Input:
imagefromsensors
• [ML.PT2←AI.D]
Output:trafficsigns,
lanemarking,
vehicles,and
pedestrians.
[ML.De1]Use
predictionresults
fordecision-
makinginself-
drivingsystem
[ML.IS1]
Usingtestdata,
achieveveryhigh
recallandhigh
precisionin
followingcondition:
night,rainy,and
generalcondition
Datasetsissplitinto
80:20ratio
[ML.MP1]
Predictionshould
bemadein
batchesreal
time.
[ML.M1]Inputdatamonitoring
[ML.VP1🡨
AI.VP1]
Providereliable
real-timeobject
detectionsystem
fordriving
decisionmakingin
highway(incl.
trafficsign
detectionand
lane/vehicle
detection)
•[ML.DS1]Procured
datasets
•[ML.DS2]Internal
databasefrom
collectionduring
operation
•[ML.DC1]Openand
commercialdatasets
•[ML.DC2]Data
collectedduring
operation(imageand
identificationresult)
•[ML.F1🡨
AI.D1/AI.D3]
Boundingbox
forobject(incl.
othervehicles
orsigns)
•[ML.F2🡨
AI.D2]Ridge
detectionfor
lanedetection
[ML.BM1]
Modelswillbe
developed,
tested,and
deployedtocars
monthly
•[ML.PT1]Input:
imagefromsensors
•[ML.PT2←AI.D]
Output:trafficsigns,
lanemarking,
vehicles,and
pedestrians.
[ML.De1]Use
predictionresults
fordecision-
makinginself-
drivingsystem
[ML.IS1]
Usingtestdata,
achieveveryhigh
recallandhigh
precisionin
followingcondition:
night,rainy,and
generalcondition
Datasetsissplitinto
80:20ratio
[ML.MP1]
Predictionshould
bemadein
batchesreal
time.
[ML.M1]Inputdatamonitoring
Adding repair-strategy
ML training
ML repair
System modeling and MLOps integration [ICEBE’23][FGCS’24][SQJ’24]
17
“Integrated Multi-view Modeling for Reliable Machine Learning-Intensive Software Engineering,” Software Quality Journal, Vol. 32, Springer, 2024.
“Enterprise Architecture-based Metamodel for a Holistic Business – IT Alignment View on Machine Learning Projects,” IEEE ICEBE 2023, Best Paper Award
“Enterprise Architecture-based Metamodel for Machine Learning Projects and its Management,” Future Generation Computer Systems, 161, 2024
Requirements
Construction
Design
Test
Architecture
Operations
Economics
Models and Methods
Quality
Requirements
analysis and design
Mainframe
70’s –
Early 80’s
Late 80’s -
Early 90’s
Late 90’s -
Early 00’s
Late 00’s -
Early 10’s
PC,
Client &
server
Internet
Ubiquitous
computing
Late 10’s -
Early 20’s
IoT,
Big data,
AI
GenAI, LLM,
Autonomous,
Quantum,
Continuum
Late 20’s
Structured
programming
Waterfall
Formalization
Design
Program
generation
Maturity
Management
Object-oriented
Req. eng.
Modeling
Verification
Reuse
Model-driven
Product-line
Global & open
Value-based
Systems eng.
Agile
Iterative &
incremental
DevOps
Empirical
Data-driven
Continuous
SE and IoT
SE and AI
SE and GenAI
SE and QC
Sustainability
SE for
autonomous
and continuum
AI-assisted
DevOps
SWEBOK V1
SWEBOK V2
SWEBOK V3
SWEBOK V4
18

More Related Content

PDF
Machine Learning Software Engineering Patterns and Their Engineering
PDF
Software Engineering Patterns for Machine Learning Applications
PDF
Opening, 1st International Workshop on Patterns and Practices of Reliable AI ...
PDF
SWEBOK Guide Evolution and Its Emerging Areas including Machine Learning Patt...
PDF
202212APSEC.pptx.pdf
PDF
AI Software Engineering based on Multi-view Modeling and Engineering Patterns
PDF
PDF
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
Machine Learning Software Engineering Patterns and Their Engineering
Software Engineering Patterns for Machine Learning Applications
Opening, 1st International Workshop on Patterns and Practices of Reliable AI ...
SWEBOK Guide Evolution and Its Emerging Areas including Machine Learning Patt...
202212APSEC.pptx.pdf
AI Software Engineering based on Multi-view Modeling and Engineering Patterns
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide

Similar to Impact of IEEE Computer Society in Advancing Software Engineering and Emerging Technologies (20)

PDF
Studying Software Engineering Patterns for Designing Machine Learning Systems
PDF
Patterns for New Software Engineering: Machine Learning and IoT Engineering P...
PDF
Machine Learning Applications In Software Engineering Series On Software Engi...
PPTX
Emerging engineering issues for building large scale AI systems By Srinivas P...
PPTX
[DSC Europe 22] AI Ethics and AI Quality By Design - Muthu Ramachandran
PDF
Sustainable & Composable Generative AI
PPTX
Software engineering for machine learning.pptx
PDF
Se research update
PDF
Landscape of IoT and Machine Learning Patterns
PDF
ANALYSIS OF SYSTEM ON CHIP DESIGN USING ARTIFICIAL INTELLIGENCE
PDF
ANALYSIS OF SYSTEM ON CHIP DESIGN USING ARTIFICIAL INTELLIGENCE
PDF
ANALYSIS OF SYSTEM ON CHIP DESIGN USING ARTIFICIAL INTELLIGENCE
PDF
2020 09-16-ai-engineering challanges
PPTX
Foutse_Khomh.pptx
PDF
20181212 ibm aot
PPTX
Integrating Machine Learning Capabilities into your team
PDF
AI and Machine Learning in Software Development.pdf
PDF
RTL DESIGN IN ML WORLD_OBJECT AUTOMATION Inc
PDF
IEEE Software Testing Technology Development Trend
PPTX
Foutse_MSR Vision keynote.pptx
Studying Software Engineering Patterns for Designing Machine Learning Systems
Patterns for New Software Engineering: Machine Learning and IoT Engineering P...
Machine Learning Applications In Software Engineering Series On Software Engi...
Emerging engineering issues for building large scale AI systems By Srinivas P...
[DSC Europe 22] AI Ethics and AI Quality By Design - Muthu Ramachandran
Sustainable & Composable Generative AI
Software engineering for machine learning.pptx
Se research update
Landscape of IoT and Machine Learning Patterns
ANALYSIS OF SYSTEM ON CHIP DESIGN USING ARTIFICIAL INTELLIGENCE
ANALYSIS OF SYSTEM ON CHIP DESIGN USING ARTIFICIAL INTELLIGENCE
ANALYSIS OF SYSTEM ON CHIP DESIGN USING ARTIFICIAL INTELLIGENCE
2020 09-16-ai-engineering challanges
Foutse_Khomh.pptx
20181212 ibm aot
Integrating Machine Learning Capabilities into your team
AI and Machine Learning in Software Development.pdf
RTL DESIGN IN ML WORLD_OBJECT AUTOMATION Inc
IEEE Software Testing Technology Development Trend
Foutse_MSR Vision keynote.pptx
Ad

More from Hironori Washizaki (20)

PDF
IEEE-CS Tech Predictions, SWEBOK and Quantum Software: Towards Q-SWEBOK
PDF
鷲崎弘宜, "AI/LLM時代のソフトウェエンジニアリング", 情報学科・専攻協議会 総会・研究会, 早稲田大学, 2025年7月26日
PDF
SWEBOK Guide and Software Services Engineering Education
PDF
Impact of IEEE Computer Society in Advancing Emerging Technologies including ...
PDF
Landscape of Requirements Engineering for/by AI through Literature Review
PDF
鷲崎弘宜, "高品質なAIシステムの開発・運用のための"フレームワーク", eAIシンポジウム 2025年1月16日
PDF
AI/IoTをベースにしたDX人材育成の産学連携育成, 愛媛県デジタル人材育成シンポジウム, 2024年12月20日
PDF
コンピューティングおよびソフトウェア工学の潮流: IEEE-CS技術予測&SWEBOK Guideに基づくAI・アジャイル・サステナビリティの展望
PDF
鷲崎弘宜, "機械学習システムの多面的モデリング・パイプライン統合フレームワーク", 第6回 AI/IoTシステム安全性シンポジウム, 2024
PDF
The Global Impact of IEEE Computer Society in Advancing Software Engineering ...
PDF
Overview of ISO/IEC/JTC1 SC7/WG20: Certification of software and systems engi...
PDF
IEEE Computer Society 2025 Vision and Future
PDF
次世代AI時代のトレンドと高信頼AIソフトウェアシステム開発に向けたフレームワーク&パターン
PDF
「スマートエスイー」におけるスマートシステム&サービスおよびDX推進人材の産学連携育成ならびに参照モデルに基づく育成プログラム分析
PDF
COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...
PDF
SWEBOK and Education at FUSE Okinawa 2024
PDF
IEEE Computer Society 2024 Technology Predictions Update
PDF
鷲崎弘宜, "国際規格ISO/IEC 24773とその意義", 情報処理学会 第86回全国大会
PDF
TISO/IEC JTC1におけるソフトウェア工学知識体系、技術者認証および品質の標準化と研究・教育他への活用
PDF
アジャイル品質のパターンとメトリクス Agile Quality Patterns and Metrics (QA2AQ) 20240225
IEEE-CS Tech Predictions, SWEBOK and Quantum Software: Towards Q-SWEBOK
鷲崎弘宜, "AI/LLM時代のソフトウェエンジニアリング", 情報学科・専攻協議会 総会・研究会, 早稲田大学, 2025年7月26日
SWEBOK Guide and Software Services Engineering Education
Impact of IEEE Computer Society in Advancing Emerging Technologies including ...
Landscape of Requirements Engineering for/by AI through Literature Review
鷲崎弘宜, "高品質なAIシステムの開発・運用のための"フレームワーク", eAIシンポジウム 2025年1月16日
AI/IoTをベースにしたDX人材育成の産学連携育成, 愛媛県デジタル人材育成シンポジウム, 2024年12月20日
コンピューティングおよびソフトウェア工学の潮流: IEEE-CS技術予測&SWEBOK Guideに基づくAI・アジャイル・サステナビリティの展望
鷲崎弘宜, "機械学習システムの多面的モデリング・パイプライン統合フレームワーク", 第6回 AI/IoTシステム安全性シンポジウム, 2024
The Global Impact of IEEE Computer Society in Advancing Software Engineering ...
Overview of ISO/IEC/JTC1 SC7/WG20: Certification of software and systems engi...
IEEE Computer Society 2025 Vision and Future
次世代AI時代のトレンドと高信頼AIソフトウェアシステム開発に向けたフレームワーク&パターン
「スマートエスイー」におけるスマートシステム&サービスおよびDX推進人材の産学連携育成ならびに参照モデルに基づく育成プログラム分析
COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...
SWEBOK and Education at FUSE Okinawa 2024
IEEE Computer Society 2024 Technology Predictions Update
鷲崎弘宜, "国際規格ISO/IEC 24773とその意義", 情報処理学会 第86回全国大会
TISO/IEC JTC1におけるソフトウェア工学知識体系、技術者認証および品質の標準化と研究・教育他への活用
アジャイル品質のパターンとメトリクス Agile Quality Patterns and Metrics (QA2AQ) 20240225
Ad

Recently uploaded (20)

PDF
OpenACC and Open Hackathons Monthly Highlights July 2025
PDF
NewMind AI Weekly Chronicles – August ’25 Week III
PDF
Hybrid horned lizard optimization algorithm-aquila optimizer for DC motor
PDF
Comparative analysis of machine learning models for fake news detection in so...
PDF
Consumable AI The What, Why & How for Small Teams.pdf
PPTX
Custom Battery Pack Design Considerations for Performance and Safety
PDF
Credit Without Borders: AI and Financial Inclusion in Bangladesh
PPTX
GROUP4NURSINGINFORMATICSREPORT-2 PRESENTATION
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
Developing a website for English-speaking practice to English as a foreign la...
PPTX
Modernising the Digital Integration Hub
PPT
What is a Computer? Input Devices /output devices
PDF
A contest of sentiment analysis: k-nearest neighbor versus neural network
PDF
The influence of sentiment analysis in enhancing early warning system model f...
PDF
sbt 2.0: go big (Scala Days 2025 edition)
PPTX
The various Industrial Revolutions .pptx
PDF
Getting started with AI Agents and Multi-Agent Systems
PDF
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
PDF
Flame analysis and combustion estimation using large language and vision assi...
PDF
STKI Israel Market Study 2025 version august
OpenACC and Open Hackathons Monthly Highlights July 2025
NewMind AI Weekly Chronicles – August ’25 Week III
Hybrid horned lizard optimization algorithm-aquila optimizer for DC motor
Comparative analysis of machine learning models for fake news detection in so...
Consumable AI The What, Why & How for Small Teams.pdf
Custom Battery Pack Design Considerations for Performance and Safety
Credit Without Borders: AI and Financial Inclusion in Bangladesh
GROUP4NURSINGINFORMATICSREPORT-2 PRESENTATION
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Developing a website for English-speaking practice to English as a foreign la...
Modernising the Digital Integration Hub
What is a Computer? Input Devices /output devices
A contest of sentiment analysis: k-nearest neighbor versus neural network
The influence of sentiment analysis in enhancing early warning system model f...
sbt 2.0: go big (Scala Days 2025 edition)
The various Industrial Revolutions .pptx
Getting started with AI Agents and Multi-Agent Systems
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
Flame analysis and combustion estimation using large language and vision assi...
STKI Israel Market Study 2025 version august

Impact of IEEE Computer Society in Advancing Software Engineering and Emerging Technologies

  • 1. Impact of IEEE Computer Society in Advancing Software Engineering and Emerging Technologies Hironori Washizaki Waseda University, Professor IEEE Computer Society 2025 President ICCA, December 18th 2024 1
  • 2. Waseda University, Tokyo, Japan • A top institution of higher education – 50,000 students in 13 undergraduate and 21 postgraduate schools 2 Japanese University Life https://www.youtube.com/watch?v=qjTqeejCWY0 • Has hosted many international software engineering and computing conferences – SPLC 2013, IEEE ICST 2017, IEEE COMPSAC 2018 (partially), ACM VRST 2018, ICIAM 2023, IEEE VCIP 2024, IEEE CSEE&T 2023 • Strong software engineering team – Prof. Hironori Washizaki: IPSJ-SIGSE 2021-2024 Chair, IEEE Computer Society 2025 President, SWEBOK Guide V4 Editor, General/PC Chair of CSEE&T, ICST and APSEC, PC member of FSE – Prof. Naoyasu Ubayashi: IPSJ-SIGSE 2013-2016 Chair, General/PC Chair of MODELS, MODULARITY/AOSD, APRES and APSEC https://commons.wikimedia.org/wiki/Category:People_associated_with_Wa seda_University?uselang=ja#/media/File:Okuma_lecture_hall_Waseda_Univ ersity_2007-01.jpg
  • 3. IEEE Computer Society: Empowering Computer Science and Engineering Professionals to Fuel Continued Advancement 3
  • 4. 4 Megatrends in IEEE Future Direction 2023 and IEEE-CS Technology Predictions 2024 IEEE CS Technology Prediction Team (Chair: Dejan Milojicic) https://www.computer.org/resources/2024-top-technology-predictions Next Gen AI Generative AI applications Metaverse Low power AI accelerator
  • 5. Knowledge Area Topic Topic Reference Material Body of Knowledge Skills Competencies Jobs / Roles SWEBOK Software Engineering Professional Certifications SWECOM EITBOK Learning courses 5 Guide to the Software Engineering Body of Knowledge (SWEBOK) https://www.computer.org/education/bodies-of-knowledge/software-engineering • Guiding researchers and practitioners to identify and have common understanding on “generally-accepted-knowledge” in software engineering • Foundations for certifications and educational curriculum • ‘01 v1, ‘04 v2, ‘05 ISO adoption, ‘14 v3, ’24 v4 just published! 5
  • 6. Mainframe 70’s – Early 80’s Late 80’s - Early 90’s Late 90’s - Early 00’s Late 00’s - Early 10’s PC, Client & server Internet Ubiquitous computing Late 10’s - Early 20’s IoT, Big data, AI Structured programming Waterfall Formalization Design Program generation Maturity Management Object-oriented Req. eng. Modeling Verification Reuse Model-driven Product-line Global & open Value-based Systems eng. Agile Iterative & incremental DevOps Empirical Data-driven Continuous SE and IoT SE and AI SWEBOK V1 SWEBOK V2 SWEBOK V3 SWEBOK V4 6
  • 7. SWEBOK Evolution from V3 to V4 • Modern engineering, practice update, BOK grows and recently developed areas Requirements Design Construction Testing Maintenance Configuration Management Engineering Management Process Models and Methods Quality Professional Practice Economics Computing Foundations Mathematical Foundations Engineering Foundations Requirements Architecture Design Construction Testing Operations Maintenance Configuration Management Engineering Management Process Models and Methods Quality Security Professional Practice Economics Computing Foundations Mathematical Foundations Engineering Foundations V3 V4 Agile, DevOps AI for SE, SE for AI Software engineering AI AI for SE SE for AI 7
  • 8. Example case of ML-based system design • We wish to identify the type of instrument for the sound picked up by the phone and achieve recording and response according to the type. • However, the memory and performance of the phone is limited, and a large deep learning model is unlikely to be loaded. How can we do this? 8 Pretrained Model • Let's use Two-stage predictions where a small model on the phone determines if a sound is a musical instrument, and a large model on the cloud classifies the type of sound only if it is a musical instrument. • For the large model, we will adopt Transfer Learning to achieve precise classification. Machine Learning Design Patterns (V. Lakshmanan, et al. 2020)
  • 9. Example of ML design patterns Two-stage predictions • Problem: There is a need to maintain the performance of models that are large and complex in nature, even when deployed to edge or distributed devices. • Solution: The utilization flow is divided into two phases, with only the simple phase performed on the edge. Transfer Learning • Problem: There is a lack of large data sets needed to train complex machine learning models. • Solution: Some layers of the trained model are taken out and the weights are frozen and used in the new model to solve similar problems without being trained. 9 Machine Learning Design Patterns (V. Lakshmanan, et al. 2020)
  • 10. AI/ML software engineering patterns • Architecture and design patterns – Software Engineering Patterns for ML applications [SEP4MLA] – Machine Learning Design Patterns [MLDP] • Safety and security patterns – Safety Case Pattern for ML systems [Safety] – Security Argument Patterns for DNN [Security] • Responsible AI patterns – Responsible AI System Design Patterns [Responsible] • Development and management practices – Lifecycle phase practices [Practice1] – Issues and development practices [Practice2] • Prompt engineering patterns – Prompt Pattern Catalog [Prompt] 10 [MLDP] V. Lakshmanan, et al., “Machine Learning Design Patterns,” O’Reilly, 2020 [SEP4MLA] H. Washizaki, et al. “Software Engineering Design Patterns for Machine Learning Applications,” IEEE Computer 55(3) 2022, Best Paper Award [Safety] E. Wozniak, et al., “A Safety Case Pattern for Systems with Machine Learning Components,” SAFECOMP 2020 Workshop [Security] M. Zeroual, et al., “Security Argument patterns for Deep Neural Network Development,” PLoP 2023 [Responsible] Q. Lu, et al., “Responsible-AI-by-Design: a Pattern Collection for Designing Responsible AI Systems,” IEEE Software, 2023 [Practice1] M. S. Rahman, et al., “Machine Learning Application Development: Practitioners’ Insights,” Software Quality Journal, 31, 2023. [Practice2] Y. Watanabe, et al., “Preliminary Literature Review of Machine Learning System Development Practices,” COMPSAC 2021 Fast Abstract [Prompt] J, White, et al., “A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT,” arXiv 2302.11382, 2023
  • 11. Business Concerns System Concerns Software Concerns Traditional Software Concerns ML Software Concerns Costs Revenues Stakeholders Integration Safety ML performance Data Quality Model architecture Reliability Experimentative Definitive 11 How to address multiple aspects in traceable and consistent way? => Metamodel-based multi-view modeling How to align different natures together? => Pipeline integration and MLOps Responsible AI patterns ML patterns ML Safety and security patterns ML architecture and design patterns How to incorporate ML patterns into development? => Application with configuration
  • 12. Multi-view modeling for ML systems [SQJ’24] ML Canvas AI Project Canvas Safety Case Architectural Diagram (SysML) KAOS Goal Model STAMP/STPA Value MLOps Architecture Goals Safety Argumentation Jati H. Husen, Hironori Washizaki, Jomphon Runpakprakun, Nobukazu Yoshioka, Hnin Thandar Tun, Yoshiaki Fukazawa, Hironori Takeuchi, “Integrated Multi-view Modeling for Reliable Machine Learning-Intensive Software Engineering,” Software Quality Journal, Vol. 32, pp. 1239–1285, Springer-Nature, 2024. 12
  • 13. Metamodel for consistency and traceability [ICEBE’23][FGCS’24] ML Canvas AI Project Canvas Safety Case KAOS Goal Model STAMP/STPA Architecture (SysML) ML workflow pipeline 13 Hironori Takeuchi, Jati H. Husen, Hnin Thandar Tun, Hironori Washizaki and Nobukazu Yoshioka, “Enterprise Architecture-based Metamodel for a Holistic Business – IT Alignment View on Machine Learning Projects,” IEEE International Conference on E-Business Engineering (ICEBE 2023), Best Paper Award Hironori Takeuchi, Jati H. Husenb, Hnin Thandar Tun, Hironori Washizaki, Nobukazu Yoshioka, “Enterprise Architecture-based Metamodel for Machine Learning Projects and its Management,” Future Generation Computer Systems, Elsevier, Vol. 161, pp. 135-145, 2024.
  • 14. ML model repair (fixing) • Retraining and online learning – A straightforward method, but time-consuming and costly – Possible side effects of performance degradation • Data augmentation: generation [a], selection [b], expansion [c], etc. – Trial and error without directly modifying model parameters – Potential vulnerability to adversarial examples • Direct modification of parameters according to specific samples – Correction for specific labels for adversarial examples [d]. – Finding and correcting impacted areas in failed data [e]. [a] Generative adversarial nets, NIPS 2014 [b] MODE: automated neural network model debugging via state differential analysis and input selection, ESEC/FSE 2018 [c] Autoaugment: Learning augmentation policies from data, arXiv:1805.09501, 2019 [d] Unlearned Modification of Neural Network Models for Adversarial Examples and Its Evaluation, JSSST 2019 [e] Search Based Repair of Deep Neural Networks, arXiv:1912.12463, 2019 Average of neuron’s output values for successful data Average of neuron’s output values for misrecognition data Neurons with high priority for fixing 14
  • 15. Example case of image classification in autonomous driving City Highway AI Project Canvas ML Canvas Architecture Data Skills Output Value proposition Integration Stakeholders Customer Cost Revenue How can we develop and revise a system based on DNNs with acceptable recognition accuracy considering safety in the city and on the highway? Jati H. Husen, Hironori Washizaki, Jomphon Runpakprakun, Nobukazu Yoshioka, Hnin Thandar Tun, Yoshiaki Fukazawa, Hironori Takeuchi, “Integrated Multi-view Modeling for Reliable Machine Learning-Intensive Software Engineering,” Software Quality Journal, Vol. 32, Springer, 2024.
  • 16. Case of ML m1 m2 m3 Evaluation of classification Safety Case Misclassified data Selection for repair Balanced repair Result of repair Aggressive repair Further revision 1. Dataset revision 2. Architecture revision for improving images 3. Revisiting business goals Misclassified data STAMP/STPA KAOS Goal Model 16 Jati H. Husen, Hironori Washizaki, Jomphon Runpakprakun, Nobukazu Yoshioka, Hnin Thandar Tun, Yoshiaki Fukazawa, Hironori Takeuchi, “Integrated Multi-view Modeling for Reliable Machine Learning-Intensive Software Engineering,” Software Quality Journal, Vol. 32, Springer, 2024. Application of assurance patterns
  • 17. Metamodel ML evaluation Visualizing issues ML evaluation Visualizing resolution OK OK OK Failed Failed OK OK OK OK OK OK OK [ML.VP1🡨 AI.VP1] Providereliable real-timeobject detectionsystem fordriving decisionmakingin highway(incl. trafficsign detectionand lane/vehicle detection) • [ML.DS1]Procured datasets • [ML.DS2]Internal databasefrom collectionduring operation • [ML.DC1]Openand commercialdatasets • [ML.DC2]Data collectedduring operation(imageand identificationresult) •[ML.F1🡨 AI.D1/AI.D3] Boundingbox forobject(incl. othervehicles orsigns) •[ML.F2🡨 AI.D2]Ridge detectionfor lanedetection [ML.BM1] Modelswillbe developed, tested,and deployedtocars monthly • [ML.PT1]Input: imagefromsensors • [ML.PT2←AI.D] Output:trafficsigns, lanemarking, vehicles,and pedestrians. [ML.De1]Use predictionresults fordecision- makinginself- drivingsystem [ML.IS1] Usingtestdata, achieveveryhigh recallandhigh precisionin followingcondition: night,rainy,and generalcondition Datasetsissplitinto 80:20ratio [ML.MP1] Predictionshould bemadein batchesreal time. [ML.M1]Inputdatamonitoring [ML.VP1🡨 AI.VP1] Providereliable real-timeobject detectionsystem fordriving decisionmakingin highway(incl. trafficsign detectionand lane/vehicle detection) • [ML.DS1]Procured datasets • [ML.DS2]Internal databasefrom collectionduring operation • [ML.DC1]Openand commercialdatasets • [ML.DC2]Data collectedduring operation(imageand identificationresult) •[ML.F1🡨 AI.D1/AI.D3] Boundingbox forobject(incl. othervehicles orsigns) •[ML.F2🡨 AI.D2]Ridge detectionfor lanedetection [ML.BM1] Modelswillbe developed, tested,and deployedtocars monthly • [ML.PT1]Input: imagefromsensors • [ML.PT2←AI.D] Output:trafficsigns, lanemarking, vehicles,and pedestrians. [ML.De1]Use predictionresults fordecision- makinginself- drivingsystem [ML.IS1] Usingtestdata, achieveveryhigh recallandhigh precisionin followingcondition: night,rainy,and generalcondition Datasetsissplitinto 80:20ratio [ML.MP1] Predictionshould bemadein batchesreal time. [ML.M1]Inputdatamonitoring [ML.VP1🡨 AI.VP1] Providereliable real-timeobject detectionsystem fordriving decisionmakingin highway(incl. trafficsign detectionand lane/vehicle detection) •[ML.DS1]Procured datasets •[ML.DS2]Internal databasefrom collectionduring operation •[ML.DC1]Openand commercialdatasets •[ML.DC2]Data collectedduring operation(imageand identificationresult) •[ML.F1🡨 AI.D1/AI.D3] Boundingbox forobject(incl. othervehicles orsigns) •[ML.F2🡨 AI.D2]Ridge detectionfor lanedetection [ML.BM1] Modelswillbe developed, tested,and deployedtocars monthly •[ML.PT1]Input: imagefromsensors •[ML.PT2←AI.D] Output:trafficsigns, lanemarking, vehicles,and pedestrians. [ML.De1]Use predictionresults fordecision- makinginself- drivingsystem [ML.IS1] Usingtestdata, achieveveryhigh recallandhigh precisionin followingcondition: night,rainy,and generalcondition Datasetsissplitinto 80:20ratio [ML.MP1] Predictionshould bemadein batchesreal time. [ML.M1]Inputdatamonitoring Adding repair-strategy ML training ML repair System modeling and MLOps integration [ICEBE’23][FGCS’24][SQJ’24] 17 “Integrated Multi-view Modeling for Reliable Machine Learning-Intensive Software Engineering,” Software Quality Journal, Vol. 32, Springer, 2024. “Enterprise Architecture-based Metamodel for a Holistic Business – IT Alignment View on Machine Learning Projects,” IEEE ICEBE 2023, Best Paper Award “Enterprise Architecture-based Metamodel for Machine Learning Projects and its Management,” Future Generation Computer Systems, 161, 2024 Requirements Construction Design Test Architecture Operations Economics Models and Methods Quality Requirements analysis and design
  • 18. Mainframe 70’s – Early 80’s Late 80’s - Early 90’s Late 90’s - Early 00’s Late 00’s - Early 10’s PC, Client & server Internet Ubiquitous computing Late 10’s - Early 20’s IoT, Big data, AI GenAI, LLM, Autonomous, Quantum, Continuum Late 20’s Structured programming Waterfall Formalization Design Program generation Maturity Management Object-oriented Req. eng. Modeling Verification Reuse Model-driven Product-line Global & open Value-based Systems eng. Agile Iterative & incremental DevOps Empirical Data-driven Continuous SE and IoT SE and AI SE and GenAI SE and QC Sustainability SE for autonomous and continuum AI-assisted DevOps SWEBOK V1 SWEBOK V2 SWEBOK V3 SWEBOK V4 18