Debian Codegraph @

doc/outreach/pydata2024.rst

raw
1 PyData Paris 2024
2 =================
3
4 .. meta::
5 :description: DataLab presentation at PyData Paris 2024 conference
6 :keywords: DataLab, PyData, PyData Paris, Python, data science, conference, Paris
7
8 Conference Overview
9 -------------------
10
11 In September 2024, DataLab was presented at `PyData Paris 2024 <https://pydata.org/paris2024/>`_, a conference dedicated to Python in data science, machine learning, and analytics. This French conference provided an opportunity to present DataLab in depth to the local scientific Python community.
12
13 DataLab Presentation
14 --------------------
15
16 **Talk Title:** *DataLab: Bridging Scientific and Industrial Worlds for Advanced Signal and Image Processing*
17
18 **Presenter:** Pierre Raybaut (Executive VP, Engineering, CODRA)
19
20 This presentation offered a comprehensive look at DataLab's capabilities through practical demonstrations and use cases relevant to both scientific research and industrial applications.
21
22 Presentation Structure
23 ^^^^^^^^^^^^^^^^^^^^^^
24
25 **Introduction**
26 DataLab as a tool merging scientific research and industrial applications.
27
28 **Live Demo**
29 The integrated demo showcasing:
30
31 - Signal processing: basic operations, peak detection, curve fitting, FWHM measurements
32 - Image processing: histogram computation, rotation, ROI management, centroid computation, contour detection
33 - Advanced features: intensity profiles, restoration filters, morphological filters, edge detection
34
35 **Getting Started**
36 - Comprehensive documentation (tutorials, API, contribution guidelines)
37 - Multiple installation methods: pip, conda, Windows installer
38 - Wide distribution channels
39
40 Four Key Use Cases
41 ^^^^^^^^^^^^^^^^^^
42
43 The presentation detailed DataLab's versatility through four distinct use cases:
44
45 **1. Analyze Signals and Images**
46 Using DataLab as a standalone application - a Swiss Army knife for data analysis with ready-to-use features and plugin extensibility.
47
48 **2. Prototype Processing Pipelines**
49 Mixing Python code with DataLab's features by exchanging data between your IDE/notebook and DataLab, benefiting from both worlds.
50
51 **3. Debug Processing Applications**
52 Establishing a connection between your application and DataLab to inspect data at different pipeline stages with visual feedback.
53
54 *Example*: Development of an automatic image stitching software for CEA, using DataLab to visualize images and results at each algorithm step.
55
56 **4. Enhance Applications**
57 Using DataLab as a library or companion application to add advanced processing features.
58
59 *Example*: Plasma diagnostic control system for CEA - the application sends images to DataLab for visualization and computation, receiving back processed results and parameters.
60
61 Validation Approach
62 ^^^^^^^^^^^^^^^^^^^
63
64 The presentation highlighted DataLab's two-tier validation process:
65
66 **Functional Validation**
67 Classic automated testing (TDD approach, CI/CD workflows) achieving 90% code coverage - exceptional for a GUI application.
68
69 **Technical (Scientific) Validation**
70 Ensuring result accuracy with 84% coverage of scientific features, with all validation status tracked and automatically documented.
71
72 Watch the Full Presentation
73 ---------------------------
74
75 .. raw:: html
76
77 <div style="max-width: 800px; margin: 2em auto;">
78 <div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;">
79 <iframe src="https://www.youtube.com/embed/yn1bR-BVfn8"
80 style="position: absolute; top: 0; left: 0; width: 100%; height: 100%;"
81 frameborder="0" allowfullscreen></iframe>
82 </div>
83 </div>
84
85 Resources
86 ---------
87
88 - `Video recording on YouTube <https://www.youtube.com/watch?v=yn1bR-BVfn8&list=PLGVZCDnMOq0pKya8gksd00ennKuyoH7v7>`_
89 - `PyData Paris 2024 conference website <https://pydata.org/paris2024/>`_
90
91 Key Takeaways
92 -------------
93
94 The PyData Paris presentation emphasized several critical aspects:
95
96 **Companion Tool Philosophy**
97 DataLab doesn't replace your IDE or Jupyter notebook - it complements them by providing:
98
99 - Ready-to-use features for data reading, editing, and visualization
100 - Fine-tuning capabilities for algorithm development
101 - Visual debugging support
102
103 **Real-World Applications**
104 Concrete examples from CEA projects demonstrated DataLab's practical value in production environments.
105
106 **Extensibility**
107 The ability to customize DataLab through plugins and macros while maintaining industrial-grade reliability.
108
109 **Documentation Excellence**
110 Automatically generated validation status documentation building trust with users.
111
112 Impact on DataLab
113 -----------------
114
115 The PyData Paris presentation and feedback contributed to:
116
117 - Increased focus on use case documentation
118 - Enhanced emphasis on the "companion tool" positioning
119 - Debugged issues with Conda package installation