Weird Task Overload issue

[Arinji2]

Might forget this so adding here, at some point the task queues slowly start overloading and not fixing themselves.. not sure why this is a case.

721 Lines in

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

Tasks In Queue:  News Nest 9

Tasks In Queue:  Listify 9

Tasks In Queue:  Word 9

Tasks In Queue:  Meme Galore 9

Fulfilled By Word In 1 Seconds

2024/11/05 11:57:57 "POST http://ai.arinji.com/completions HTTP/1.1" from 172.18.0.1:49348 - 200 62B in 1.01550694s

Fulfilled By Listify In 1 Seconds

825 lines (Word has fallen apart)

Task Processing Timed Out

2024/11/05 11:59:26 "POST http://ai.arinji.com/completions HTTP/1.1" from 172.18.0.1:49640 - 504 25B in 1m29.998919153s

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

Fulfilled By News Nest In 0 Seconds

2024/11/05 11:59:27 "POST http://ai.arinji.com/completions HTTP/1.1" from 172.18.0.1:59326 - 200 65B in 410.036006ms

Fulfilled By Listify In 0 Seconds

2024/11/05 11:59:27 "POST http://ai.arinji.com/completions HTTP/1.1" from 172.18.0.1:59304 - 200 84B in 492.894003ms

Tasks In Queue:  News Nest 3

Tasks In Queue:  Listify 3

Tasks In Queue:  Meme Galore 5

Fulfilled By Meme Galore In 1 Seconds

1000+ lines in

2024/11/05 12:29:27 "POST http://ai.arinji.com/completions HTTP/1.1" from 172.18.0.1:53882 - 504 25B in 1m29.998966017s

Task Processing Timed Out

2024/11/05 12:29:27 "POST http://ai.arinji.com/completions HTTP/1.1" from 172.18.0.1:53890 - 504 25B in 1m30.000118674s

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

NEW REQUEST RECEIVED

Tasks In Queue:  Listify 6

Tasks In Queue:  News Nest 7

Fulfilled By Listify In 1 Seconds

2024/11/05 12:29:27 "POST http://ai.arinji.com/completions HTTP/1.1" from 172.18.0.1:46846 - 200 95B in 972.430269ms

Fulfilled By News Nest In 1 Seconds

2024/11/05 12:29:28 "POST http://ai.arinji.com/completions HTTP/1.1" from 172.18.0.1:46850 - 200 55B in 1.080394278s

Slowly each task queue breaks apart, have to investigate on why this is happening.
https://pastebin.com/z4t5M4z5
Paste uptil News Nest is the last queue still active.

[Arinji2]

Added a temporary fix to exit the server. Since docker has a restart policy of always.. this will restart the server.
8a61d65