-
Notifications
You must be signed in to change notification settings - Fork 28
feat(security): Add package name typosquatting detection #1059
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Thank you for your pull request and welcome to our community! To contribute, please sign the Oracle Contributor Agreement (OCA).
To sign the OCA, please create an Oracle account and sign the OCA in Oracle's Contributor Agreement Application. When signing the OCA, please provide your GitHub username. After signing the OCA and getting an OCA approval from Oracle, this PR will be automatically updated. If you are an Oracle employee, please make sure that you are a member of the main Oracle GitHub organization, and your membership in this organization is public. |
Implement typosquatting detection for package names during analysis. Compares package names against a list of popular packages using the Jaro-Winkler similarity algorithm. Packages exceeding a defined threshold of similarity to a popular package are flagged. Signed-off-by: Amine <r1@Amines-MacBook-Pro.local>
Adds a new security analysis feature to detect potential typosquatting in package names. Compares the package name against a list of popular packages using the Jaro-Winkler similarity algorithm. Packages exceeding a configurable threshold are flagged. Includes a default popular package list and an option for a custom list via configuration. Signed-off-by: Amine <amine.raouane@enim.ac.ma>
Adds a new security analysis feature to detect potential typosquatting in package names. Compares the package name against a list of popular packages using the Jaro-Winkler similarity algorithm. Packages exceeding a configurable threshold are flagged. Includes a default popular package list and an option for a custom list via configuration. Signed-off-by: Amine <amine.raouane@enim.ac.ma>
@AmineRaouane Please add unit tests following the instructions here. Take a look at the unit tests for other malware heuristics at For small and standalone functions, you can add test cases to the docstring itself. You can find an example here. |
Would it be possible to make the path to the custom file list of packages configurable through |
Added unit tests for typosquatting detection. Analyzer variables, including the file path, are now loaded from defaults.ini. Raised heuristic confidence level from medium to high. BREAKING CHANGE: Analyzer config must now be defined in defaults.ini. Signed-off-by: Amine <amine.raouane@enim.ac.ma>
src/macaron/malware_analyzer/pypi_heuristics/metadata/typosquatting_presence.py
Show resolved
Hide resolved
src/macaron/malware_analyzer/pypi_heuristics/metadata/typosquatting_presence.py
Outdated
Show resolved
Hide resolved
src/macaron/malware_analyzer/pypi_heuristics/metadata/typosquatting_presence.py
Outdated
Show resolved
Hide resolved
src/macaron/malware_analyzer/pypi_heuristics/metadata/typosquatting_presence.py
Outdated
Show resolved
Hide resolved
src/macaron/malware_analyzer/pypi_heuristics/metadata/typosquatting_presence.py
Outdated
Show resolved
Hide resolved
src/macaron/malware_analyzer/pypi_heuristics/metadata/typosquatting_presence.py
Outdated
Show resolved
Hide resolved
Signed-off-by: Amine <amine.raouane@enim.ac.ma>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I see some .DS_Store
files being checked into the Pull Request. Could you please remove them and may be add an entry for it to .gitignore
?
@@ -395,12 +397,18 @@ def run_check(self, ctx: AnalyzeContext) -> CheckResultData: | |||
failed({Heuristics.ONE_RELEASE.value}), | |||
failed({Heuristics.ANOMALOUS_VERSION.value}). | |||
|
|||
% Package released with a name similar to a popular package. | |||
{Confidence.HIGH.value}::trigger(malware_high_confidence_4) :- |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can this be placed further up in the text under malware_high_confidence_3
? Just for readability.
% ----- Evaluation ----- | ||
|
||
% Aggregate result | ||
{problog_result_access} :- trigger(malware_high_confidence_1). | ||
{problog_result_access} :- trigger(malware_high_confidence_2). | ||
{problog_result_access} :- trigger(malware_high_confidence_3). | ||
{problog_result_access} :- trigger(malware_high_confidence_4). | ||
{problog_result_access} :- trigger(malware_high_confidence_5). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't see any rule defined for malware_high_confidence_5
?
with open(self.popular_packages_path, encoding="utf-8") as file: | ||
popular_packages = file.read().splitlines() | ||
except OSError as exception: | ||
err_msg = f"Could not read popular packages file {self.popular_packages_path}: {exception}" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you raise a HeuristicAnalyzerValueError
here as opposed to returning HeuristicResult.SKIP
? Please take a look at #1052 to understand how the error and skip results should be used.
tuple[HeuristicResult, dict[str, JsonType]]: | ||
The result and related information collected during the analysis. | ||
""" | ||
if not self.popular_packages_path or not os.path.exists(self.popular_packages_path): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should we maybe open and store the file when initializing the analyzer? That way this error can be caught earlier? I do something similar in 965
if not popular_packages: | ||
err_msg = f"Popular packages file is empty: {self.popular_packages_path}" | ||
logger.warning(err_msg) | ||
return HeuristicResult.SKIP, {"error": err_msg} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Similarly here with raising an error instead of skipping.
Implement typosquatting detection for package names during analysis. Compares package names against a list of popular packages using the Jaro-Winkler similarity algorithm. Packages exceeding a defined threshold of similarity to a popular package are flagged.
Summary
Adds typosquatting detection for package names during analysis using Jaro-Winkler similarity.
Description of changes
This PR introduces a new security analysis feature to detect potential typosquatting in package names. The implementation compares the name of a package being analyzed against a list of popular package names. By default, it uses a predefined list stored in a dedicated file, but it also offers an option to use a custom list provided via a configuration path.
The comparison utilizes the Jaro-Winkler similarity algorithm to calculate a similarity score between the package name and each name in the popular packages list. If the calculated similarity score exceeds a configurable threshold, the package is flagged as a potential typosquat.
This feature helps identify malicious packages attempting to mimic legitimate, popular ones through slight variations in spelling, thus enhancing the security posture of the project by warning users about such risks.
The changes include:
Related issues
Checklist
verified
label should appear next to all of your commits on GitHub.