Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix queue handling in K8sIntegration and k8s_glue_example.py #183

Merged

Conversation

a-klos
Copy link
Contributor

@a-klos a-klos commented Jan 25, 2024

Facilitate, that in the clearml-agent helm chart, multiple queues can be assigned with following format: 'queue1,queue2'.

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
@@ -91,7 +95,10 @@ def k8s_user_props_cb(pod_number=0):
ssh_port_number=args.ssh_server_port) if args.ssh_server_port else None,
namespace=args.namespace, max_pods_limit=args.max_pods or None,
)
k8s.k8s_daemon(args.queue, use_owner_token=args.use_owner_token)
if "," in args.queue:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems too elaborate, you can simply do:

args.queue = [q.strip() for q in args.queue.split(",") if q.strip()]

Which would also handle input such as "queue1,"

COPY ./clearml.conf /root/clearml.conf

#TODO: should be adjusted
RUN python3 -m pip uninstall clearml-agent -y && python3 -m pip install git+https://github.com/FeU-aKlos/clearml-agent.git@feature/support_multi_queeus_with_k8s
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there is still the dockerimage linked, which i created my self, I was not sure how to handle the thing, that the clearml-agent python package should be installed, for usage in the helm chart, without the actual (official) repo having the changes. Any Ideas on that? Should i adjust the setup.sh script and reference my fork there for pip install or the main branch, if i expect, that this PR will be accepted...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

or in the entrypoint.sh

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't leave your repo here - once we merge the PR we'll build a new image and publish it

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay, great, thanks for clarification

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants