How do I view the archived chats?

[auer1329]

Hello, I deployed chatvault via docker compose:

services:
  database:
    image: 'postgres:16'
    container_name: chatvault-database
    environment:
      - POSTGRES_DB=chatvault
      - POSTGRES_PASSWORD=secret
      - POSTGRES_USER=usr_chatvault
    ports:
      - '5432:5432'
    volumes:
      - pgdata16:/var/lib/postgresql/data
    
  chatvault:
    image: ghcr.io/vitormarcal/chatvault:latest
    container_name: chatvault
    environment:
      - SPRING_DATASOURCE_URL=jdbc:postgresql://database:5432/chatvault
      - SPRING_DATASOURCE_USERNAME=usr_chatvault
      - SPRING_DATASOURCE_PASSWORD=secret
      - CHATVAULT_MSGPARSER_DATEFORMAT="dd.MM.yyyy, HH:mm"
      - CHATVAULT_HOST=chatvault
    ports:
      - 8080:8080
      - 3000:3000
    volumes:
      - archive:/opt/chatvault/archive
      - /volume1/docker/chatvault/import:/opt/chatvault/import
      - /volume1/docker/chatvault/config:/config
    depends_on:
      - database


volumes:
  pgdata16:
  archive:

But after importing archive files from WhatsApp, the page still only shows this:

The readme on github specifies port 3000 for the frontend, but it is not accessible, even if exposed via docker compose.

Can somebody tell me, what I am doing wrong?

chatvault logs of newly created container start and import of a chat:

  .   ____          _            __ _ _
 /\\ / ___'_ __ _ _(_)_ __  __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
 \\/  ___)| |_)| | | | | || (_| |  ) ) ) )
  '  |____| .__|_| |_|_| |_\__, | / / / /
 =========|_|==============|___/=/_/_/_/
 :: Spring Boot ::                (v3.2.1)
2024-10-11T09:16:53.328Z  INFO 1 --- [           main] dev.marcal.chatvault.Boot$Companion      : Starting Boot.Companion using Java 21.0.4 with PID 1 (/app/chatvault.jar started by root in /app)
2024-10-11T09:16:53.336Z  INFO 1 --- [           main] dev.marcal.chatvault.Boot$Companion      : No active profile set, falling back to 1 default profile: "default"
2024-10-11T09:16:56.443Z  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode.
2024-10-11T09:16:56.899Z  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 425 ms. Found 3 JPA repository interfaces.
2024-10-11T09:16:57.269Z  INFO 1 --- [           main] faultConfiguringBeanFactoryPostProcessor : No bean named 'errorChannel' has been explicitly defined. Therefore, a default PublishSubscribeChannel will be created.
2024-10-11T09:16:57.291Z  INFO 1 --- [           main] faultConfiguringBeanFactoryPostProcessor : No bean named 'integrationHeaderChannelRegistry' has been explicitly defined. Therefore, a default DefaultHeaderChannelRegistry will be created.
2024-10-11T09:16:58.825Z  INFO 1 --- [           main] o.s.b.w.embedded.tomcat.TomcatWebServer  : Tomcat initialized with port 8080 (http)
2024-10-11T09:16:58.872Z  INFO 1 --- [           main] o.apache.catalina.core.StandardService   : Starting service [Tomcat]
2024-10-11T09:16:58.873Z  INFO 1 --- [           main] o.apache.catalina.core.StandardEngine    : Starting Servlet engine: [Apache Tomcat/10.1.17]
2024-10-11T09:16:58.974Z  INFO 1 --- [           main] o.a.c.c.C.[Tomcat].[localhost].[/]       : Initializing Spring embedded WebApplicationContext
2024-10-11T09:16:58.977Z  INFO 1 --- [           main] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 5324 ms
2024-10-11T09:16:59.607Z  INFO 1 --- [           main] o.hibernate.jpa.internal.util.LogHelper  : HHH000204: Processing PersistenceUnitInfo [name: default]
2024-10-11T09:16:59.783Z  INFO 1 --- [           main] org.hibernate.Version                    : HHH000412: Hibernate ORM core version 6.4.1.Final
2024-10-11T09:16:59.866Z  INFO 1 --- [           main] o.h.c.internal.RegionFactoryInitiator    : HHH000026: Second-level cache disabled
2024-10-11T09:17:00.547Z  INFO 1 --- [           main] o.s.o.j.p.SpringPersistenceUnitInfo      : No LoadTimeWeaver setup: ignoring JPA class transformer
2024-10-11T09:17:00.635Z  INFO 1 --- [           main] com.zaxxer.hikari.HikariDataSource       : HikariPool-1 - Starting...
2024-10-11T09:17:01.353Z  INFO 1 --- [           main] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@16e907b6
2024-10-11T09:17:01.357Z  INFO 1 --- [           main] com.zaxxer.hikari.HikariDataSource       : HikariPool-1 - Start completed.
2024-10-11T09:17:03.452Z  INFO 1 --- [           main] o.h.e.t.j.p.i.JtaPlatformInitiator       : HHH000489: No JTA platform available (set 'hibernate.transaction.jta.platform' to enable JTA platform integration)
2024-10-11T09:17:06.418Z  WARN 1 --- [           main] o.h.engine.jdbc.spi.SqlExceptionHelper   : SQL Warning Code: 0, SQLState: 00000
2024-10-11T09:31:28.346Z  INFO 1 --- [nio-8080-exec-1] o.s.web.servlet.DispatcherServlet        : Completed initialization in 3 ms
2024-10-11T09:57:31.152Z  INFO 1 --- [nio-8080-exec-6] d.m.c.a.b.BucketServiceImpl              : bucket /opt/chatvault/archive/6767397e-913d-4afd-9786-6c2cdbc005c3 not exists, creating...
2024-10-11T09:57:31.153Z  INFO 1 --- [nio-8080-exec-6] d.m.c.a.b.BucketServiceImpl              : bucket /opt/chatvault/archive/6767397e-913d-4afd-9786-6c2cdbc005c3 created
2024-10-11T09:57:31.154Z  INFO 1 --- [nio-8080-exec-6] d.m.c.a.b.BucketServiceImpl              : File save at /opt/chatvault/archive/6767397e-913d-4afd-9786-6c2cdbc005c3/2016-02-29-PHOTO-00007072.jpg
...
(shortened)
...
2024-10-11T09:57:33.054Z  INFO 1 --- [nio-8080-exec-6] d.m.c.a.b.BucketServiceImpl              : File save at /opt/chatvault/archive/6767397e-913d-4afd-9786-6c2cdbc005c3/2014-10-03-PHOTO-00000012.jpg
2024-10-11T09:57:33.058Z  INFO 1 --- [nio-8080-exec-6] d.m.c.a.b.BucketServiceImpl              : File save at /opt/chatvault/archive/6767397e-913d-4afd-9786-6c2cdbc005c3/_chat.txt

netstat output:

[vitormarcal]

You only need to expose port 8080 for this. It's likely that the app saved the files but couldn't parse each line of messages in the chat file. You can confirm this by querying the database; the messages haven't been saved.

What is the name of your chat message file? Is it _chat.txt? If so, your generated file is different from mine, and I need to apply a fix because the regex used to identify a chat file is:

chatvault/backend/usecase/src/main/kotlin/dev/marcal/chatvault/usecase/ChatFileImporterUseCase.kt

Line 34 in 053c826

private val possiblyWhatsappTalk = Regex(".*WhatsApp.*\\.txt$")

Renaming the file to something that matches this regex should work.

Update: I just fixed the issue in the latest version of the image.

[auer1329]

Thanks for the quick fix, now the importer recognizes the .txt file, but I get the next error:

dev.marcal.chatvault.in_out_boundary.output.exceptions.MessageParserException: Parse text fail. Unexpected situation for the line 30.09.14, 23:25:46: Christoph Auer: 👍😄

This happens with and without the environment variable
CHATVAULT_MSGPARSER_DATEFORMAT="dd.MM.yy, HH:mm:ss" (I also tried SS for the seconds)

[vitormarcal]

I checked here and noticed two issues with the parser: the seconds and the colon after the date. My file follows this pattern, with a - instead of : :
30.09.14, 23:25 - Christoph Auer: 👍😄.

I’ve fixed it now. Unfortunately, each device can generate a different file. If anything goes wrong, please let me know.

[auer1329]

I got one last error with the datetime parser, which was solved using the following variable (apparently the comma and the space in the datetime string need to be escaped with a single quote ' before the character)

CHATVAULT_MSGPARSER_DATEFORMAT=dd.MM.yy',' HH:mm:ss

[auer1329]

So I am still not able to import some chats.

It fails with the following error:

2024-10-14T08:10:14.843Z  INFO 1 --- [nio-8080-exec-3] d.m.c.a.b.BucketServiceImpl              : File save at /opt/chatvault/archive/aa791c67-372d-4839-be42-f8c085a6cabc/00000751-PHOTO-2017-01-20-14-55-47.jpg
2024-10-14T08:10:14.847Z  INFO 1 --- [nio-8080-exec-3] d.m.c.a.b.BucketServiceImpl              : File save at /opt/chatvault/archive/aa791c67-372d-4839-be42-f8c085a6cabc/_chat.txt
2024-10-14T08:10:14.876Z ERROR 1 --- [nio-8080-exec-3] d.m.c.web.config.WebControllerAdvice     : The request failed due to an unprocessable entity error at
dev.marcal.chatvault.in_out_boundary.output.exceptions.MessageParserException: Parse text fail. Unexpected situation for the line [16.11.16, 12:25:03] Name: Name hat die Gruppe erstellt.

When I open the _chat.txt file, it shows LRM characters that may be the problem.

[vitormarcal]

Thanks for reporting. The LRM character was not mapped when it appeared before the date. I have fixed it now.