This document tabulates the state of the slides in lecture_*/slides/<chapter>/ based on

  1. compilation checks (does it compile,and if not, is there a salient error message?) and
  2. (optionally and rarely) comparison with presumably “known good” versions of the slides located in lecture_*/slides-pdf/

Latest Commits

Displaying the latest commits of the lecture service repository and each of the currently included lectures (for debugging and race condition mitigation (kind of)).

Status of the lecture_service repo (time in UTC)
Branch Last Commit By Message
main 2026-05-12 11:35:05 Bernd Bischl better math rules
Latest commits per lecture (times in UTC)
Lecture Branch Last Commit By Message
lecture_optimization main 2026-09-22 15:36:39 Timo Heiß Rework nelder-mead figures

If you’re missing a lecture here after rendering this site interactively, you might have to add them to the included_lectures files or ensure they are downloaded correctly.

Slide status

Click to expand explanation of table columns 
lecture_advml/slides/gaussian-processes/slides-gp-bayes-lm.tex
\___________/        \________________/ \________________/
   lecture                 chapter            <slide-name>

lecture_advml/slides-pdf/slides-gp-bayes-lm.pdf
                        \___________________/
                       pdf_static / "Reference PDF"

Tables are organized by lecture (first level) and lecture chapters corresponding to folders in slides/<chapter> (second level), with a table per chapter. chapters ignore certain folders like attic and all.

  • Slide: The <slide-name> with a link to the compiled .tex file (if it compiles).
  • Compiles?: Whether the .tex file compiles without error using latexmk -pdf. This can depend on the availability of specific LaTeX dependencies, but assuming they are not the issue, this usually indicates syntax issues or things like \includegraphics calls using relative paths that work on Overleaf but not locally.
  • Comparison: Checking the compiled <slide-name>.tex against slides-pdf/<slide-name>.pdf using diff-pdf-visually:
    • ❌: The check failed surely, either due to differing page counts or because there is no reference PDF.
    • ❓: The check indicates differences on at least one slide, but they may be minor and need manual checking.
    • ✅: The check seems to be fine, the PDF files match.
  • Note: A comment on the previous column listing the specific reason for a failing check. Also enumerates the slide pages where differences are found, and links to a PDF containing a diff of the two files generated with diff-pdf (at a lower resolution than the originals).

lecture_optimization

11 chapters with a total of 66 slides

01-foundations

Slide Compiles? Note
01-diff ✅
02-taylor ✅
03-convex ✅
04-optcond ✅
05-qfun ✅
06-matcalc ✅

02-problems

Slide Compiles? Note
01-unconstrained ✅
02-constrained ✅
03-other ✅

03-univopt

Slide Compiles? Note
01-golden ✅
02-brent ✅
03-further ✅

04-classicfirst

Slide Compiles? Note
01-gd ✅
02-stepsize ✅
03-optimality ✅
04-curvature ✅
05-saddle ✅

05-second

Slide Compiles? Note
01-nr ✅
02-nrconv ✅
03-nrlimit ✅
04-quasinewton ✅
05-gaussnewton ✅
06-optimr ✅
07-compare ✅
08-fisher ✅
09-irls ✅

06-advfirst

Slide Compiles? Note
01-momentum ✅
02-gdquad ✅
03-momquad ✅
04-sgd ✅
05-adam ✅
06-compare ✅
07-practice ✅
08-autodiff ✅

07-constrained

Slide Compiles? Note
01-intro NA
02-lp ✅
03-simplex ✅
04-lpsolvers ✅
05-duality ✅
06-lagrangian ✅
07-fenchel ✅
08-regularity ✅
09-solvers ✅

08-derivfree

Slide Compiles? Note
01-coorddesc ✅
02-neldermead ✅
03-annealing ✅
04-multistart ✅

09-evolutionary

Slide Compiles? Note
01-intro ✅
01-intro ✅
02-numeric ✅
03-bit ✅
04-cmaes ✅
05-cmaeswrap ✅

10-bayesopt

Slide Compiles? Note
01-blackbox ✅
02-loop ✅
03-acqfun1 ✅
04-acqfun2 ✅
05-surrogate ✅
06-noisy ✅
07-multicrit ✅
08-practical ✅

11-multicrit

Slide Compiles? Note
01-intro1 ✅
02-intro2 ✅
03-evolutionary ✅
04-bo ✅
05-practical ✅

Figure Audit

After compilation, .fls recorder files capture every file the TeX engine opened. This allows robust detection of which figures each slide actually uses, including dynamically constructed paths (e.g. \foreach loops) that regex-based parsing misses.

Figures in figure/ or figure_man/ that are not referenced by any slide are orphaned. Figures referenced by slides but missing from disk are missing.

Each lecture chapter may have two figure directories:

  • figure/ — generated figures, typically produced by R scripts in rsrc/
  • figure_man/ — manually created or externally sourced figures, not generated by scripts

Figures are counted separately per figure/ and figure_man/ folders:

  • Total means all figures in the respective folder
  • Orphaned figures are in the folder but not used by any .tex file in the chapter
  • Missing figures are referenced in .tex files but not in folder (will cause LaTeX compilation error anyway)
  • Attic counts figures in an attic subfolder which might need to be cleaned out
Figure audit summary
figure/
figure_man/
Lecture Chapter Total Orphaned Missing Attic Total Orphaned Missing
lecture_optimization 01-foundations 16 16 0 0 24 24 0
lecture_optimization 02-problems 17 17 0 0 19 19 0
lecture_optimization 03-univopt 28 28 0 0 1 1 0
lecture_optimization 04-classicfirst 19 19 0 0 38 38 0
lecture_optimization 05-second 29 29 0 0 2 2 0
lecture_optimization 06-advfirst 48 48 0 0 39 39 0
lecture_optimization 07-constrained 10 10 0 0 12 12 0
lecture_optimization 08-derivfree 14 14 0 0 20 20 0
lecture_optimization 09-evolutionary 12 12 0 0 27 27 0
lecture_optimization 10-bayesopt 54 54 0 0 14 14 0
lecture_optimization 11-multicrit 22 22 0 0 17 17 0

Chapters with issues

lecture_optimization / 01-foundations

16 orphaned figure(s) in figure/:

  • branin.png
  • branin3d_2d.pdf
  • branin3d_3d.pdf
  • conv_conc_functions.png
  • conv-first-order-cond.png
  • convexity_1.pdf
  • convexity_2.pdf
  • gradient.png
  • hinge_vs_l2.pdf
  • quadr-eigenv.png
  • quadratic_functions_1D_curvature.png
  • quadratic_functions_1D_derivative.png
  • quadratic_functions_1D.png
  • quadratic_functions_2D_example_1_1.png
  • quadratic_functions_2D_example_1_2.png
  • taylor_univariate.png

24 orphaned figure(s) in figure_man/:

  • 1920px-Greek_lc_delta.svg.png
  • concave.png
  • convex-example.png
  • convex.jpg
  • convex.png
  • differentiability_multivariate.png
  • first_order.png
  • gradient.png
  • gradient2.png
  • gradient3.png
  • hessian_3d.png
  • hessian_contour.png
  • Jacobian.png
  • local_global_min_2D.png
  • local_global_min.png
  • minmaxsaddle.png
  • quadr-conds.png
  • rockafellar-siam-rev.png
  • tangent.png
  • taylor_2D_quadratic.png
  • Taylor2D_1st100.png
  • Taylor2D_1st301.png
  • Taylor2D_2nd-100.png
  • Taylor2D_2nd-301.png

lecture_optimization / 02-problems

17 orphaned figure(s) in figure/:

  • hinge.png
  • linreg.png
  • logreg-0-0.1.png
  • logreg-0-1.png
  • logreg-0.5-0.1.png
  • logreg-0.5-1.png
  • logreg-0.png
  • logreg-1-0.1.png
  • logreg-1-1.png
  • ml_linreg_example_1.png
  • ml_linreg_example_2.png
  • ml_normal_example_dnorm.pdf
  • ml_normal_example_negloglike_nooptim.pdf
  • ml_normal_example_negloglike.pdf
  • ml_poisson_example_1.pdf
  • ml_poisson_example_2.pdf
  • unit_circle.png

19 orphaned figure(s) in figure_man/:

  • boundary_with_violations.png
  • classes_optimization_problems.png
  • cp_example.jpg
  • feature_subset_selection.png
  • hpo_loop_1.png
  • landscapes2.jpg
  • lasso.png
  • log_reg.png
  • ml_landscape.jpg
  • newrep_n_f.png
  • nonlinear-svm-c.pdf
  • pareto.png
  • quadratic-programm.jpeg
  • ridge.png
  • simplex_iter1.png
  • simplex.png
  • subset_selection.png
  • svm_geometry.png
  • svm-example.pdf

lecture_optimization / 03-univopt

28 orphaned figure(s) in figure/:

  • golden-ratio-0.png
  • golden-ratio-1.png
  • golden-ratio-10.png
  • golden-ratio-11.png
  • golden-ratio-12.png
  • golden-ratio-13.png
  • golden-ratio-2.png
  • golden-ratio-3.png
  • golden-ratio-4.png
  • golden-ratio-5.png
  • golden-ratio-6.png
  • golden-ratio-7.png
  • golden-ratio-8.png
  • golden-ratio-9.png
  • golden-ratio-summary.png
  • golden-section-placement.png
  • goldensec-0.png
  • goldensec-1.png
  • goldensec-3.png
  • goldensec-4.png
  • goldensec.png
  • poisson.pdf
  • quadratic-1.pdf
  • quadratic-2.pdf
  • quadratic-3.pdf
  • quadratic-4.pdf
  • quadratic-5.pdf
  • secant.pdf

1 orphaned figure(s) in figure_man/:

  • quadratic-title.png

lecture_optimization / 04-classicfirst

19 orphaned figure(s) in figure/:

  • ackley.png
  • armijo.pdf
  • curvature_1.png
  • curvature_2.png
  • descent_direction.pdf
  • fixed_vs_adaptive.pdf
  • gradient_descent_lm.pdf
  • gradient_descent_logistic.pdf
  • gradient_descent_NN_0.pdf
  • gradient_descent_NN_10_history.pdf
  • gradient_descent_NN_10_surface.pdf
  • gradient_descent_NN_100_history.pdf
  • gradient_descent_NN_100_surface.pdf
  • gradient_descent_NN_300_history.pdf
  • gradient_descent_NN_300_surface.pdf
  • nn_architecture.pdf
  • saddle_point_grad_norm.pdf
  • stepsize_large.png
  • stepsize_small.png

38 orphaned figure(s) in figure_man/:

  • ackley_0a.png
  • ackley_0b.png
  • ackley_1.png
  • backtracking-example.png
  • bracketing-pinpointing-example.png
  • conv-first-order-cond.png
  • curvature.png
  • difficult_vs_easy.png
  • gd_conv.png
  • gd_eigenspace.png
  • gd.png
  • gdes_1.png
  • gradient_descent_NN_10_surface.pdf
  • gradient_descent_NN_100_surface.pdf
  • gradient_descent_NN_300_history.pdf
  • gradient_descent_NN_300_surface.pdf
  • gradient-descent-example_1.png
  • gradient-descent-example_2.png
  • ill-cond_1.png
  • ill-cond_2.png
  • line_search_rosenbrock_alpha.png
  • line_search_rosenbrock.png
  • linesearch.png
  • local_hill.png
  • minima.png
  • no_critical.png
  • opt1.png
  • opt10.png
  • opt2.png
  • opt3.png
  • pseudo_residual_1.png
  • saddlepoint.png
  • stepsize_adaptive.png
  • stepsize_large.png
  • stepsize_small.png
  • taylor_2D_quadratic.png
  • wolfe_bracketing.png
  • wolfe_pinpointing.png

lecture_optimization / 05-second

29 orphaned figure(s) in figure/:

  • NR_boyd_1_contour.png
  • NR_boyd_1_error.png
  • NR_boyd_2_contour.png
  • NR_boyd_2_error.png
  • NR_boyd_5_contour.png
  • NR_boyd_5_error.png
  • NR_divergence.png
  • NR_GD_log_coef_1000indep.png
  • NR_GD_log_coef_50indep_corr.png
  • NR_GD_log_coef_50indep.png
  • NR_GD_log_indep_1000iters.png
  • NR_GD_log_indep_50iters_corr.png
  • NR_GD_log_indep_50iters.png
  • NR_GD_runtime_comparison_corr.png
  • NR_GD_runtime_comparison.png
  • NR_overshoot_1_contour.png
  • NR_overshoot_1_error.png
  • NR_overshoot_2_contour.png
  • NR_overshoot_2_error.png
  • NR_overshoot_3_contour.png
  • NR_overshoot_3_error.png
  • NR_overshoot_damped_contour.png
  • NR_overshoot_damped_error.png
  • NR_phases.png
  • NR_quad_approx_good.png
  • NR_quadratic_form.png
  • NR_saddle_1d.png
  • NR_saddle_2d.png
  • squares.png

2 orphaned figure(s) in figure_man/:

  • aggarwal_fig5-7_inverse_hessian.jpg
  • aggarwal_fig5-8_worsening_step.jpg

lecture_optimization / 06-advfirst

48 orphaned figure(s) in figure/:

  • gd_conv.pdf
  • gd_quadratic_forms_wspace.pdf
  • gd_quadratic_forms_xspace.pdf
  • gradient_descent_NN_0.pdf
  • gradient_descent_NN_10_history_0.5.pdf
  • gradient_descent_NN_10_surface_0.5.pdf
  • gradient_descent_NN_100_history_0.5.pdf
  • gradient_descent_NN_100_surface_0.5.pdf
  • gradient_descent_NN_300_history_0.5.pdf
  • gradient_descent_NN_300_history_0.pdf
  • gradient_descent_NN_300_surface_0.5.pdf
  • gradient_descent_NN_SGD_vs_no_SGD.pdf
  • momentum_comparison_overshoot.pdf
  • momentum_comparison.pdf
  • momentum_conv_1step.pdf
  • momentum_conv_div.pdf
  • momentum_conv_mono.pdf
  • momentum_conv_osc.pdf
  • momentum_conv_ripples.pdf
  • momentum_conv.pdf
  • momentum_traj_1step.pdf
  • momentum_traj_div.pdf
  • momentum_traj_mono.pdf
  • momentum_traj_osc.pdf
  • momentum_traj_ripples.pdf
  • nn_architecture.pdf
  • simu-linmods/GD_log_coef_med_corr.pdf
  • simu-linmods/GD_log_coef_med.pdf
  • simu-linmods/GD_log_med_lr_corr_iters.pdf
  • simu-linmods/GD_log_med_lr_iters.pdf
  • simu-linmods/GD_reg_coef_large.pdf
  • simu-linmods/GD_reg_coef_med_corr.pdf
  • simu-linmods/GD_reg_coef_med.pdf
  • simu-linmods/GD_reg_coef_small.pdf
  • simu-linmods/GD_reg_large_lr_iters.pdf
  • simu-linmods/GD_reg_med_lr_corr_iters.pdf
  • simu-linmods/GD_reg_med_lr_iters.pdf
  • simu-linmods/GD_reg_small_lr_iters.pdf
  • simu-linmods/SGD_log_coef_large.pdf
  • simu-linmods/SGD_log_coef_med.pdf
  • simu-linmods/SGD_log_large_lr_iters.pdf
  • simu-linmods/SGD_log_med_lr_iters.pdf
  • simu-linmods/SGD_reg_coef_large.pdf
  • simu-linmods/SGD_reg_coef_med.pdf
  • simu-linmods/SGD_reg_large_lr_iters.pdf
  • simu-linmods/SGD_reg_med_lr_iters.pdf
  • simu-mnist/SGD_compar.pdf
  • simu-mnist/SGD_GD_compar.pdf

39 orphaned figure(s) in figure_man/:

  • gradient_descent_NN_10_surface_0.5.pdf
  • gradient_descent_NN_100_surface_0.5.pdf
  • gradient_descent_NN_300_history_0.5.pdf
  • gradient_descent_NN_300_history_0.pdf
  • gradient_descent_NN_300_surface_0.5.pdf
  • linesearch.png
  • momentum_1step.png
  • momentum_conv_1step.png
  • momentum_conv_div.png
  • momentum_conv_mono.png
  • momentum_conv_osc.png
  • momentum_conv_ripples.png
  • momentum_convergence.png
  • momentum_div.png
  • momentum_illustration_medium.png
  • momentum_mono.png
  • momentum_osc.png
  • momentum_ripples.png
  • momentum_vectors.png
  • momentum/compare_gd_momentum.png
  • momentum/comparison_adam.png
  • momentum/comparison_momentum_overshoot.png
  • momentum/sgd_momentum_saddlepoint.png
  • momentum/sgd_without_momentum.png
  • nesterov_momentum.png
  • nesterov.jpeg
  • sattle_point2-100.png
  • sattle_point2-50.png
  • SGD_cropped.png
  • sgd_example_batch_size.png
  • sgd_example_confusion_areas.png
  • sgd_example_decreasing_step_size.png
  • sgd_example_erratic_behavior.png
  • sgd_example_iter_1.png
  • sgd_example_iter_2.png
  • sgd_example_iter_3.png
  • sgd_example_iter_4.png
  • sgd_example_iter_5.png
  • SGD.png

lecture_optimization / 07-constrained

10 orphaned figure(s) in figure/:

  • cons-linear-pro-example.png
  • cons-opposite-direction.png
  • cons-solutions-lp.png
  • ridge-constrained.png
  • ridge-penalized.png
  • ridge-unregularized.png
  • simplex_implementation-1.png
  • simplex_implementation-2.png
  • simplex_implementation-3.png
  • simplex_implementation-4.png

12 orphaned figure(s) in figure_man/:

  • constraint_lagrange.PNG
  • convex_programs.png
  • ellipse.PNG
  • fenchel.png
  • lasso-ridge.png
  • milkmaid1.png
  • milkmaid2.png
  • milkmaid3.png
  • milkmaid4.png
  • milkmaid5.png
  • simplex.png
  • Weak_and_Strong_Duality.png

lecture_optimization / 08-derivfree

14 orphaned figure(s) in figure/:

  • himmelblau-iter3_probabilities.pdf
  • metropolis-algorithm.png
  • metropolis-algorithm2.png
  • metropolis-example-nelder.png
  • metropolis-local-search.png
  • nelder_mead_steps_1.png
  • nelder_mead_steps_2.png
  • nelder_mead_steps_3.png
  • nelder_mead_steps_4.png
  • nelder_mead_steps_5.png
  • nelder_mead_steps_6.png
  • nelder_mead_steps_7.png
  • nelder_mead_steps_8.png
  • nelder_mead_steps_9.png

20 orphaned figure(s) in figure_man/:

  • Coordinate_descent.png
  • levy.png
  • Nelder01.png
  • Nelder02.png
  • Nelder03.png
  • Nelder04.png
  • Nelder06.png
  • nm_animation2d_1.PNG
  • nm_animation2d_2.PNG
  • nm_animation2d_3.PNG
  • nm_animation2d_4.PNG
  • nm_gd_cities_1.PNG
  • nm_gd_cities_2.PNG
  • nm_gd_cities_3.PNG
  • nm_gd_cities_4.PNG
  • nm_gd_cities_5.PNG
  • nm_gd_cities_6.PNG
  • nm_gd_cities_7.PNG
  • nm_gd_cities_8.PNG
  • Nonsmooth_coordinate_descent.png

lecture_optimization / 09-evolutionary

12 orphaned figure(s) in figure/:

  • 1dim-ackley-func-2.png
  • 1dim-ackley-func-final.png
  • 1dim-ackley-func-gaussian-mutation.png
  • 1dim-ackley-func-neutral-selec.png
  • 1dim-ackley-func-selection.png
  • 1dim-ackley-func.png
  • ea_parent_selection.pdf
  • ea_recombination_numeric.pdf
  • grid.png
  • one_max_example.pdf
  • var-selection1.png
  • var-selection2.png

27 orphaned figure(s) in figure_man/:

  • cmaes/cmaes_benchmark.png
  • cmaes/cmaes_eda.png
  • cmaes/cmaes_generations.png
  • cmaes/cmaes_muds_1.png
  • cmaes/cmaes_muds_2.png
  • cmaes/cmaes_muds_3.png
  • cmaes/cmaes_muds_4.png
  • cmaes/cmaes_update_1.png
  • cmaes/cmaes_update_2.png
  • cmaes/cmaes_update_21.png
  • cmaes/cmaes_update_3.png
  • cmaes/cmaes_update_4.png
  • cmaes/cmaes_update_5.png
  • cmaes/cmaes_update_6.png
  • cmaes/cmaes_update_7.png
  • cmaes/cmaes_update_8.png
  • cmaes/cumulative-step-size.png
  • ea_recombination_uniform.png
  • ea-eps-converted-to.pdf
  • ea.eps
  • encoding_binary_numeric.png
  • encoding_tree_1.png
  • encoding_tree_2.png
  • example3.png
  • polynomial_mutation.png
  • rec-and-mut.png
  • tournament_selection.png

lecture_optimization / 10-bayesopt

54 orphaned figure(s) in figure/:

  • bayesian_loop_1.png
  • bayesian_loop_2.png
  • bayesian_loop_3.png
  • bayesian_loop_4.png
  • bayesian_loop_5.png
  • bayesian_loop_6.png
  • bayesian_loop_ee.png
  • bayesian_loop_lcb_0.png
  • bayesian_loop_lcb_1.png
  • bayesian_loop_lcb_2.png
  • bayesian_loop_pi_0.png
  • bayesian_loop_pi_1.png
  • bayesian_loop_pi_2.png
  • bayesian_loop_pi_3.png
  • bayesian_loop_pi_4.png
  • bayesian_loop_pi_5.png
  • bayesian_loop_pi_6.png
  • bayesian_loop_pi_7.png
  • bayesian_loop_pi_8.png
  • bayesian_loop_pi_9.png
  • bayesian_loop_sm_fmin.png
  • bayesian_loop_sm_normal_fmin.png
  • bayesian_loop_sm_normal.png
  • bayesian_loop_sm.png
  • black_box_0.png
  • black_box_1.png
  • black_box_2.png
  • init_0.png
  • init_1.png
  • loop_0.png
  • loop_1.png
  • loop_10.png
  • loop_11.png
  • loop_2.png
  • loop_3.png
  • loop_4.png
  • loop_5.png
  • loop_6.png
  • loop_7.png
  • loop_8.png
  • loop_9.png
  • multicrit_0.png
  • multicrit_1.png
  • multicrit_2.png
  • multicrit_3.png
  • multicrit_4.png
  • noisy_0.png
  • noisy_2.png
  • noisy_3.png
  • noisy_4.png
  • noisy_5.png
  • practical.png
  • surrogate_1.png
  • surrogate_2.png

14 orphaned figure(s) in figure_man/:

  • 01_BlackBox.png
  • black_box.tex
  • cookie.jpg
  • cookie2.png
  • cross-in-tray.jpg
  • FlowchartMBMO_parego.pdf
  • FlowchartMBMO_sms.pdf
  • FlowchartMBMO.pdf
  • hv_contr_plot.pdf
  • hv_plot.pdf
  • Multimodal-example1.png
  • random_forests.jpg
  • robot_gait.png
  • sms_plot.pdf

lecture_optimization / 11-multicrit

22 orphaned figure(s) in figure/:

  • dataset_adult_age_sex.png
  • dataset_adult_education.png
  • dataset_adult_race.png
  • example_parego_spam_outer_pareto.png
  • example_parego_spam_outer.png
  • example_parego_spam.png
  • expedia-1-1.pdf
  • expedia-10-1.pdf
  • expedia-11-1.pdf
  • expedia-2-1.pdf
  • expedia-4-1.pdf
  • expedia-5-1.pdf
  • expedia-9-1.pdf
  • graph1.png
  • graph2.png
  • graph3.png
  • hv_contrib.png
  • NSGA2_CS1.png
  • NSGA2_CS2.png
  • NSGA2_NDS.png
  • NSGA2_steps.png
  • parego_viz.png

17 orphaned figure(s) in figure_man/:

  • booking1.png
  • booking2.png
  • dominated_hypervolume.png
  • example_epsilon_constraint.pdf
  • example_unit_arc.pdf
  • expedia_weighted_sum.pdf
  • expedia-weighted-pareto_100.pdf
  • expedia-weighted-pareto_300.pdf
  • hv_contribution_2.pdf
  • hv_contribution.pdf
  • mosmafs_presentation_p14.pdf
  • mosmafs_presentation_p39.pdf
  • mosmafs_sonar_eval_domHV.pdf
  • NSGA2.png
  • parego_viz.png
  • Pfisterer_et_al_2019_Multi_Objective_fig4.pdf
  • Wang_et_al_2019_Evolving_Deep_Neural_Networks_fig7_1.png