Scribd
Upload
25 views15 pages

Lecture 3

Uploaded by

muteekhan20
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
25 views15 pages

Lecture 3

Uploaded by

muteekhan20
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 15

Common Simulation Pitfalls

We Shall understand
 General and programming mistakes
 Simulation inaccuracies
 Misleading results
When to simulate!

• Analytical model not feasible(complex)


• Analytical model not possible(too simple)
• Simulate to verify analysis
• Otherwise simulations are unnecessary

When not to simulate!

• Analytical model gives good enough representation


• Simulation takes months
• Simulation is expensive
• Simulation is non-scalable
General mistakes
• Inappropriate levels of details
• Improper selection of programming language
• Improper initial conditions

General mistakes(continued…..)

• Short run times


• Poor random number generators
• Inadequate time estimate
• No achievable goals
• Incomplete mix of essential
• Inadequate level of user participation
• Inability to manage simulation project
Simulation inaccuracies

• Over reliance on link budget methods for abstraction


• Overly simplistic modeling of ratio layers
Common Simulation Pitfalls

We Shall understand
 General and programming mistakes
 Simulation inaccuracies
 Misleading results
General mistakes

1. Improper programming language


• Scope & type of simulation determine best choice
• Object oriented vs procedural
- Types/diversity of simulation parameters
• Interpreted vs compiled
- Machine dependence
- Speed
2. Unverified models
• Programming is non trivial
• Semantic mistakes make simulations get
- Wrong results
- Misleading results
• Modular verification a must
3. Improper initial conditions
• Initial condition not steady state
• Often a late realization
• Surprisingly wrong results
• May never converge
4. Short run times
• Strong dependence on initial conditions
• Don’t achieve true steady state
5. Poor random number generators
• Lacking pseudo-random sequence leads to predictability
• Wrong choice of seed value could cause inadvertent correlation
between processes
- Use celebrated RNGs
6. No achievable goals
• Goals not defined
- Tangible output analysis
- Logs and trace files
• Goals are unreal
- Affects simulation complexity and implementation
7. Incomplete mix of essential skills
• Domain knowledge
• Statistics
• Programming
• Project management
• Past experience
8. Inadequate level of user participation
• From modelling to implementation
• UI design
• Output analysis
9. Inability to manage simulation project
• Simulations are not monolithic
• Need software engineering tools
-Multivariate design
- Code management
-Track changes
Simulation inaccuracies

1. Over reliance on the link budget methods for abstraction


• Link budget losses overly static
- Fair enough for steady state analysis
- Dynamic analysis not possible
• Result are misleading
2. Overly simplistic modeling of ratio layers
• Lowest layer often ignored
- No bit level BER & delay
• Often the Achilles heel
• Wrong results in highly dynamic use cases
Solve the

Short run times


Inappropriate levels
of No
details Clear Improper initial
goals Conditions
Improper selection of
Programming language Short run times

Inadequate time Poor RNG No SE tools


estimate
Unverified models

Lacking essential skills


No user
Participation
Link/radio layers
Development of System Simulation

We Shall understand
 The process of development of systems simulations
 Development life cycle
Development Process

1. Problem formulation
• Identify controllable and uncontrollable inputs
2. Data collection & analysis
• What to collect
• How much to collect
• Cost and accuracy trade off
3. Simulation development
• Codify, codify and codify!
4. Model validation, verification, & calibration
• Validation
• Is it the right system?
• Emulates real phenomenon
5. “What-if” analysis
• Performance measures with different inputs
6. Model validation, verification, & calibration
• Verification
• Are we building the system right?
• Implementation Must correspond to the model
7. Model validation, verification, & calibration
• Calibration
• Parameter estimation
• Tweaking/tuning to ensure that simulated data
follows real data
8. Sensitivity analysis
• Relative importance of different parameters with
respect to output
• Even with respect to each other
Life cycle of Simulation Development

1-Descriptive analysis

validation, verification basic model

2- Prescriptive analysis

Sensitivity and the Sensitivity and the


what-if-analysis what-if-analysis

3- Post prescriptive
analysis
Sensitivity and the what-if-analysis

You might also like