Updated Simulating events from a video (markdown)

supitalp 2019-09-16 14:57:45 +02:00
parent 1025597bf8
commit 048f6f98c8

@ -1,5 +1,9 @@
In this tutorial, we will show how to use ESIM to simulate events from a given video. In this tutorial, we will show how to use ESIM to simulate events from a given video.
[[https://github.com/uzh-rpg/rpg_esim/blob/master/event_camera_simulator/img/example_video_to_events.gif|alt=Example conversion from video to events]]
Left: simulated APS frames (including motion blur)
Right: simulated events with ESIM.
### WARNING ### WARNING
Simulating events from a video **will not work for any video**. The input video needs to have a sufficiently high framerate: the pixel displacement between successive images needs to be small (i.e. a few pixels at most). Simulating events from a video **will not work for any video**. The input video needs to have a sufficiently high framerate: the pixel displacement between successive images needs to be small (i.e. a few pixels at most).
@ -10,7 +14,7 @@ Otherwise, the simulated events will be of poor quality.
An overview of the conversion method is shown in the diagram below. First, we will extract the individual frames from the input video in a folder. Second, we will run ESIM, providing the image folder as an input to simulate events. An overview of the conversion method is shown in the diagram below. First, we will extract the individual frames from the input video in a folder. Second, we will run ESIM, providing the image folder as an input to simulate events.
Finally, we will see how to visualize the simulated events using the `dvs_renderer` node. Finally, we will see how to visualize the simulated events using the `dvs_renderer` node.
[[https://github.com/uzh-rpg/rpg_esim/blob/master/event_camera_simulator/img/overview_video_to_events.png]] [[https://github.com/uzh-rpg/rpg_esim/blob/master/event_camera_simulator/img/overview_video_to_events.png|alt=Overview of the methodology to convert a video to events]]
### (Optional) Download an example video ### (Optional) Download an example video