Feature: Video Support

[JW-CH]

Discussion for #499

[kdy1968]

edge browser will throw following error in dev console, when it stops:
2.CP0lzG2d.js:7 Uncaught (in promise) TypeError: Cannot read properties of undefined (reading '1')
at 2.CP0lzG2d.js:7:26786
at un (doAnGi5V.js:1:19862)
at dt (doAnGi5V.js:1:11120)
at $t (doAnGi5V.js:1:11169)
at re (doAnGi5V.js:1:21561)
at Object.play (2.CP0lzG2d.js:7:27881)
at Proxy.play (2.CP0lzG2d.js:29:1496)
at async Object.ne [as onDone] (2.CP0lzG2d.js:33:2681)

[simowilso]

@JW-CH I get this error in chrome too, when it stops. Have not seen this in the released immichframe, it's run for a few hours now.

2.B60KXuTk.js:7 Uncaught (in promise) TypeError: Cannot read properties of undefined (reading '1')
at 2.B60KXuTk.js:7:26846
at un (doAnGi5V.js:1:19862)
at dt (doAnGi5V.js:1:11120)
at $t (doAnGi5V.js:1:11169)
at re (doAnGi5V.js:1:21561)
at Proxy.z (2.B60KXuTk.js:7:28114)
at Proxy.play (2.B60KXuTk.js:29:1581)
at async Object.ee [as onDone] (2.B60KXuTk.js:33:2860)

[JoeRu]

ups.. if i've seen this earlier...
ok.. I've made another implementation. Most parts are nearly the same. On some we differ from our Idea. I've implemented a test-feature Videos-only..
https://github.com/JoeRu/ImmichFrame/tree/Video

This is naturally a branch from my PR - as it was my base to start from.

[kdy1968]

Is there a docker image

[JoeRu]

i pushed one

    image: jayar79/immichframe-video
#ghcr.io/immichframe/immichframe:latest

You need to set

Accounts:
#    ShowVideosOnly: true
    ShowVideos: true

[kdy1968]

awesome thanks! seems to be running very good

[JoeRu]

You could check the other feature included:
"ChronologicalImagesCount": 3
Then there is shown a set of pictures/Videos of 3 (for example) in historical line up.

[simowilso]

Thanks for this - I've noticed two issues with ghcr.io/immichframe/immichframe:video_playback

1. any image following a video playback seems to only display very quickly, less than the interval time (my interval is 3 sec)
2. playback stops after a while, no error in log

[simowilso]

Yes, subsequent image after a video is only shown very briefly, possibly less than one second. The immich-frame container is hosted on the same device as immich, it's a Proxmox virtual machine running Ubuntu. It's not super powerful but also not slow. 4 cpu/12Gb ram.

[simowilso]

I lied - interval is now set to 20 secs not 3. Could it be the issue that the video clips I have are longer than the interval time, so somehow the timer is being started for the next image even though the video is still playing?

[JW-CH]

@simowilso I just pushed another version to the ghcr.io/immichframe/immichframe:video_playback, can you test the 'skipping' again? Also, I added support for audio.

[simowilso]

Just did a quick test: skipping appears to be fixed, thanks! Sound not tested yet. It still seems to stop fairly frequently without any error in the container log. Strangely if I open developer tools (chrome) then the playback so far hasn't stopped.

[JW-CH]

@simowilso I am building another version with some more fixes, pull again in like 10 minutes :P

[JW-CH]

@kdy1968 @simowilso @3rob3 I updated the image/tag ghcr.io/immichframe/immichframe:video_playback with my latest changes. If you are still available for testing, feel free to do so :) I did not test this on a frameo so far! Video assets do get streamed from the server, so a relatively good connection is required.

[simowilso]

If I use the back arrow, then the previous image animates as before, but it freezes every time at the end of the animation on the subsequent image. Also, during the animation there is no progress bar.

If I skip forward to the next asset, then back to the asset that freezes, it will display the progress bar and continue. But, If I skip forward, then back to the prior asset that freezes, it will freeze again. https://streamable.com/rwaige

[JW-CH]

It will stop (and resume) if the video is loading/buffering. It is also recommended to have an encoded version on the immich server.

[JW-CH]

If I use the back arrow, then the previous image animates as before, but it freezes every time at the end of the animation on the subsequent image. Also, during the animation there is no progress bar.

If I skip forward to the next asset, then back to the asset that freezes, it will display the progress bar and continue. But, If I skip forward, then back to the prior asset that freezes, it will freeze again. https://streamable.com/rwaige

Thank you for the video! I think there is a misunderstanding here. The 'animation' is not a video. This feature request is about being able to display/play videos in immichframe. The animation (Ken Burns effect) is for images and yes, the animation is not stopped when you click the pause button.

I also noticed that the progressbar sometimes gets hidden, but that is also not what I tackled in this PR.

[simowilso]

Hi yes I know that asset is an image, not a video. My concern is that adding video may have caused a regression. The issue is that in that particular example, the playback stops altogether. I was not trying to pause the animation effect.

[simowilso]

@JW-CH I just changed my compose file to use the current immich (removed the video_playback tag).
Nothing else is changed, same album etc.

This one appears to play without any pause, so it does indeed look to me like some regression has crept in.

[simowilso]

I'm itching to build/buy a wall display but waiting for this before I do. I'm ready to test if there's any update. Thanks.

[asfixia]

I dont understood why but in my frameo the videos never starts playing.
It shows the initial frame but never starts to actually plays it.

PS: I enabled transcoding in my immich to h264 in my comuter it does work.

Am i doing something wrong ? Why is this happening?

[3rob3]

I dont understood why but in my frameo the videos never starts playing. It shows the initial frame but never starts to actually plays it.

PS: I enabled transcoding in my immich to h264 in my comuter it does work.

https://frame.recalcards.com

Am i doing something wrong ? Why is this happening?

I had to go into immich transcode settings, and set it transcode everything.

[asfixia]

I think I've selected to transcode everything too:

Transcoding policy: to "All Videos" or something like it.
Video Codec options: Codec video to h264 and Codec audio mp3 resolution 480p

Yet it doesnt work idk why.

[asfixia]

I think I've selected to transcode everything too:

Transcoding policy: to "All Videos" or something like it. Video Codec options: Codec video to h264 and Codec audio mp3 resolution 480p

Yet it doesnt work idk why.

I removed the password on immichframe and now its working.

I Found the bug, it is when i use the AuthenticationSecret on the yaml config, the video fails to include the password/token:

General:
AuthenticationSecret: '------'

[3rob3]

I think I've selected to transcode everything too:
Transcoding policy: to "All Videos" or something like it. Video Codec options: Codec video to h264 and Codec audio mp3 resolution 480p
Yet it doesnt work idk why.

I removed the password on immichframe and now its working.

I Found the bug, it is when i use the AuthenticationSecret on the yaml config, the video fails to include the password/token:

General: AuthenticationSecret: '------'

Nice catch. I think @JW-CH may have mentioned this.