Millions of Pageviews
How to manage a Matomo with millions of pageviews per month? -- Watch live at https://live.matomocamp.org/URWXGR

    Millions of Pageviews

    Lukas (MatomoCamp) created this room.

    This is the start of export of Millions of Pageviews. Exported by Lukas (@lukas:lw1.at) at 2021/11/29.


    Topic: How to manage a Matomo with millions of pageviews per month? -- Watch live at https://live.matomocamp.org/URWXGR

  1. Lukas (MatomoCamp) joined the room
  2. Lukas (MatomoCamp) set the main address for this room to #millions-of-pageviews:matomocamp.org.
  3. Lukas (MatomoCamp) made the room public to whoever knows the link.
  4. Lukas (MatomoCamp) made future room history visible to anyone.
  5. Lukas (MatomoCamp) changed the room name to Millions of Pageviews.
  6. Lukas (MatomoCamp) changed the topic to "How to manage a Matomo with millions of pageviews per month? -- Watch live at https://live.matomocamp.org/URWXGR".
  7. Lukas (MatomoCamp) invited Lukas
  8. Lukas (MatomoCamp) invited Markus
  9. Lukas (MatomoCamp) invited silva.arapi
  10. Avatar
    Lukas joined the room
  11. Lukas (MatomoCamp) changed the power level of @lukas:lw1.at from Default to Admin.
  12. Markus joined the room
  13. Avatar
    Lukas changed the power level of @markus:matomocamp.org from Default to Moderator.
  14. Avatar
    silva.arapi joined the room
  15. Avatar
    Lukas changed the power level of @silva.arapi:matrix.org from Default to Moderator.
  16. Avatar
    Tomas Persson joined the room
  17. Peter Boehlke joined the room
  18. Avatar
    Lukas invited Jorge Powers
  19. markus changed their display name to Markus
  20. peterbo changed their display name to peter.boehlke
  21. peter.boehlke changed their display name to Peter Boehlke
  22. Avatar
    Jorge Powers joined the room
  23. Avatar
    tomper00 changed their display name to Tomas Persson
  24. Avatar
    Tomas Persson set a profile picture
  25. Avatar
    Jorge Carvajal Powers changed their display name to Jorge Powers
  26. Avatar
    Jorge Powers set a profile picture
  27. Avatar
    ronanchardonneau joined the room
  28. Avatar
    alfonso.aponte joined the room
  29. Avatar
    Valentin Baraise joined the room
  30. lrm joined the room
  31. maxwalter joined the room
  32. robertolopez joined the room
  33. Avatar
    Stefan Giehl joined the room
  34. saqib16 joined the room
  35. Mikael Jonsson (datamicke) joined the room
  36. niklasternstedt joined the room
  37. Avatar
    putte joined the room
  38. Avatar
    ronan_hello joined the room
  39. Toni Barberà Melià joined the room
  40. Mikael Jonsson (datamicke)
    I'm having problem to connect. Is it just me?
  41. Valentin Baraise
    Avatar
    We are waiting for the speaker to be ready
    (edited)
  42. niklasternstedt
    Same for me
  43. ronanchardonneau
    Avatar
    me too
  44. Lukas
    Avatar
    The stream is intentionally not yet online
  45. ronanchardonneau
    Avatar
    the speaker Jorge is having technical issues
  46. niklasternstedt
    It says the media could not be loaded
  47. saqib16
    same here It says the media could not be loaded
  48. maxwalter
    I also get an error message in the video player
  49. Lukas
    Avatar
    The error message is just because we are preparing yet. The stream will start soon
  50. Avatar
    Elisa de Castro Guerra joined the room
  51. Avatar
    Marcus Österberg joined the room
  52. Lukas
    Avatar
    It should be live now
  53. Valentin Baraise
    Avatar
    you can refresh
  54. maxwalter
    It is working now!
  55. Avatar
    Marcus Österberg set a profile picture
  56. silva.arapi
    Avatar
    All good now, feel free to share your questions here for Jorge
  57. Avatar
    Stefan Koning joined the room
  58. ronanchardonneau
    Avatar
    the sound is getting better and better
  59. Avatar
    stefan_koning changed their display name to Stefan Koning
  60. Avatar
    Stefan Koning set a profile picture
  61. Avatar
    Tassoman joined the room
  62. Tassoman
    Avatar
    Only me is buffering?
  63. Marcus Österberg
    Avatar
    No buffering here, but sound is lagging.
  64. niklasternstedt
    No, for me as well, especcially the sound is lagging.
  65. Mikael Jonsson (datamicke)
    try to change the videoquality to lower.
  66. ronanchardonneau
    Avatar
    so from my understanding Kubernetes has been the key to the project here. https://en.wikipedia.org/wiki/Kubernetes
  67. Lukas
    Avatar
    At least for me the stream is working fine
  68. Åsa Sohlén joined the room
  69. Tassoman
    Avatar
    I'm fine now with 720p thanks!
  70. maxwalter
    Now i also got buffering issues but it works better when i lower the quality
  71. ronanchardonneau
    Avatar
    i am getting them too, but still hearable
  72. niklasternstedt

    In reply to this message

    Even the sound?
  73. ronanchardonneau
    Avatar
    and understandable
  74. Lukas
    Avatar
    The sound issues are unfortunately also in our conferencing tool
  75. Tomas Persson
    Avatar
    Yes changing quality to 720 helped a lot
  76. Valentin Baraise
    Avatar
    Thanks for contributing to OpenSource with this repo !
  77. ronanchardonneau
    Avatar
    This question is for the speaker. Have you ever use the Matomo fake visitor plugin in order to have enough data within your Matomo data in order to make some crash test? Do you have any feedback you could give us in order to make some crash test with an empty Matomo database? the idea would be to educate ourselves about system administration. Thank you
  78. Avatar
    Morten Bjerregaard joined the room
  79. Valentin Baraise
    Avatar
    That's a lot of load !
    (edited)
  80. robertolopez
    With million of page views, how big is your database ? Have you ever met issues regarding the size of your db and the archive proess?
  81. ronanchardonneau
    Avatar
    Hi robertolopez nice to see you here, feel free to ask as many questions as you can to Jorge. We have until 12:00.
  82. Tomas Persson
    Avatar
    Our biggest db is around 800 GB and yes this affects archiving
  83. Valentin Baraise
    Avatar
    How long do you keep data for 800Gb of data?
  84. Marcus Österberg
    Avatar
    Question to the speaker: Perhaps I missed the number of events at Skatteverket. The figures you showed were pageviews, right?
  85. maxwalter
    Is MariaDB not supported in Matomo or is it not recommended for large installations of Matomo?
  86. Tomas Persson
    Avatar
    delete_logs_older_than setting is set to 400 days
  87. Marcus Österberg: yes that was pageviews only!
  88. ronanchardonneau
    Avatar
    Thank you Jorge for answering my question.
  89. Marcus Österberg
    Avatar

    In reply to this message

    Interesting! I would've guessed the seasonality would be even larger around April.
  90. Mikael Jonsson (datamicke)
    Have you done perfomancetesting/loadtesting be done by external company, same as webpagetesting?
  91. robertolopez
    Jorge Powers: thank you for your answers...
  92. Valentin Baraise
    Avatar
    Thank you !
  93. maxwalter
    Jorge Powers: Thank you for the answer!
  94. Stefan Koning
    Avatar
    Thanks!
  95. lrm
    Thank you!
  96. Morten Bjerregaard
    Avatar
    Thank you!
  97. alfonso.aponte
    Avatar
    Great session Jorge
  98. maxwalter
    Thank you for the presentation Jorge Powers !
  99. Marcus Österberg
    Avatar
    Thanks!
  100. robertolopez
    👍️ thank you !!
  101. Lukas
    Avatar
    This chat room will stay open for the whole MatomoCamp. So if you still have questions to Jorge Powers or Tomas Persson, you can still ask them here.
  102. Åsa Sohlén
    Thanks!
  103. Lukas
    Avatar
    And if you want to give them feedback for the talk, you can contact them directly or post them at https://schedule.matomocamp.org/matomocamp-2021/talk/URWXGR/feedback/
  104. Jorge Powers
    Avatar

    In reply to this message

    No, we test ourselves.
  105. In reply to this message

    Here's the link to the issue: https://issues.matomo.org/14858
  106. In reply to this message

    We rotate the logs, so it's steadily around 800GB-1TB I would say. We have probably peaked at 1.3TB.
  107. alteria joined the room
  108. Morten Bjerregaard
    Avatar
    Thanks :-)
  109. Alexandra Girel joined the room
  110. Alexandra Girel left the room
  111. Avatar
    Elisa de Castro Guerra left the room
  112. datamicke changed their display name to Mikael Jonsson (datamicke)