Skip to content

Add user group cache for Fuse SystemUserGroupAuthPolicy#17726

Open
humengyu2012 wants to merge 1 commit intoAlluxio:master-2.xfrom
humengyu2012:fuse-uid-cache
Open

Add user group cache for Fuse SystemUserGroupAuthPolicy#17726
humengyu2012 wants to merge 1 commit intoAlluxio:master-2.xfrom
humengyu2012:fuse-uid-cache

Conversation

@humengyu2012
Copy link
Copy Markdown
Contributor

@humengyu2012 humengyu2012 commented Jul 3, 2023

What changes are proposed in this pull request?

Add user group cache for Fuse SystemUserGroupAuthPolicy.

Why are the changes needed?

We have a directory with an owner named "hive". This directory contains 1000 files. When our local fuse does not have a user named "hive", it will invoke the "id -u" command 1000 times. Listing this directory would take 8 seconds. After adding caching, this time can be reduced to less than 0.5 seconds.

List in hdfs:
image

List in fuse:
image

And log in fuse:
image

Does this PR introduce any user facing changes?

Please list the user-facing changes introduced by your change, including

  1. change in user-facing APIs NO
  2. addition or removal of property keys YES
  3. webui NO
@ChunxuTang
Copy link
Copy Markdown
Member

Thanks for the work!
@LuQQiu Would you mind taking a look at this PR?

Copy link
Copy Markdown
Contributor

@maobaolong maobaolong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It LGTM

@jja725 jja725 requested a review from LuQQiu September 25, 2023 19:33
@jja725
Copy link
Copy Markdown
Contributor

jja725 commented Sep 25, 2023

Seems like this could be applied to 3.x? @LuQQiu

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

4 participants