Feature: support when re index will delete the files not in remote

[Woody-Hu]

What problem does this PR solve?

#11460

for sync via time span, it may difficult due to no delete record

Type of change

• New Feature (non-breaking change which adds functionality)

[KevinHuSh]

Appreciations!

ragflow/api/db/services/connector_service.py

Line 70 in e0e1d04

def rebuild(cls, kb_id:str, connector_id: str, tenant_id:str):

Re-index will delete all files firstly.

For #11460, it needs to remove deleted file in increamental synchronization, dosen't it?

[Woody-Hu]

Appreciations!

ragflow/api/db/services/connector_service.py

Line 70 in e0e1d04

def rebuild(cls, kb_id:str, connector_id: str, tenant_id:str):

Re-index will delete all files firstly.
For #11460, it needs to remove deleted file in increamental synchronization, dosen't it?

add a work round solution

[ZhenhangTung]

@Woody-Hu Hi! I'm the product manager. Really appreciate your contribution. Could you wait for @Furkan-Demir 's response to my question #11460 (comment)?

[Woody-Hu]

@Woody-Hu Hi! I'm the product manager. Really appreciate your contribution. Could you wait for @Furkan-Demir 's response to my question #11460 (comment)?

now I add a os env to control this due to I found it is difficult to find a config name to describe this at front end. We can continue discuss.

[ZhenhangTung]

I can design a UI control for this feature, and once it’s ready, you’ll be able to manage it directly from the interface.