application hangs on fuse module

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

application hangs on fuse module

yin zhuhua
I got a wired application hang on fuse module as below. Did you see the same problem? I did not reproduce the problem using fusexmp_fh. The "-o direct_io" was enabled.

[<ffffffffa17a8181>] wait_answer_interruptible+0x81/0xc0 [fuse]

[<ffffffffa17a839b>] __fuse_request_send+0x1db/0x2b0 [fuse]

[<ffffffffa17a8482>] fuse_request_send+0x12/0x20 [fuse]

[<ffffffffa17aecc7>] fuse_send_write+0xe7/0x120 [fuse]

[<ffffffffa17b14e3>] fuse_direct_io+0x3a3/0x7a0 [fuse]

[<ffffffffa17b1965>] __fuse_direct_write+0x85/0xb0 [fuse]

[<ffffffffa17b1a34>] fuse_direct_write+0xa4/0xd0 [fuse]

[<ffffffff81199c68>] vfs_write+0xb8/0x1a0

[<ffffffff8119a7a1>] sys_write+0x51/0xb0

[<ffffffff8100b0d2>] system_call_fastpath+0x16/0x1b

[<ffffffffffffffff>] 0xffffffffffffffff


Sometimes the hang stack is

[<ffffffffa05692ad>] __fuse_request_send+0xed/0x2b0 [fuse]

[<ffffffffa0569482>] fuse_request_send+0x12/0x20 [fuse]

[<ffffffffa056fcc7>] fuse_send_write+0xe7/0x120 [fuse]

[<ffffffffa05724e3>] fuse_direct_io+0x3a3/0x7a0 [fuse]

[<ffffffffa0572965>] __fuse_direct_write+0x85/0xb0 [fuse]

[<ffffffffa0572a34>] fuse_direct_write+0xa4/0xd0 [fuse]

[<ffffffff81199e48>] vfs_write+0xb8/0x1a0

[<ffffffff8119a981>] sys_write+0x51/0xb0

[<ffffffff8100b0d2>] system_call_fastpath+0x16/0x1b

[<ffffffffffffffff>] 0xffffffffffffffff


Often the application running on top of the fuse file system hangs after it started 1 hour. In case the application hangs, I can do whatever operation on that mount point.

What suggestion would you give? Thanks in advance.

Regards,
Zhuhua


------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/xeonphi
--
fuse-devel mailing list
To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel
Reply | Threaded
Open this post in threaded view
|

Re: application hangs on fuse module

Nikolaus Rath
Hi

On Dec 08 2016, yin zhuhua <[hidden email]> wrote:

> I got a wired application hang on fuse module as below. Did you see the
> same problem? I did not reproduce the problem using fusexmp_fh. The "-o
> direct_io" was enabled.
>
> [<ffffffffa17a8181>] wait_answer_interruptible+0x81/0xc0 [fuse]
>
> [<ffffffffa17a839b>] __fuse_request_send+0x1db/0x2b0 [fuse]
>
> [<ffffffffa17a8482>] fuse_request_send+0x12/0x20 [fuse]
>
> [<ffffffffa17aecc7>] fuse_send_write+0xe7/0x120 [fuse]
>
> [<ffffffffa17b14e3>] fuse_direct_io+0x3a3/0x7a0 [fuse]

Are you sure that you reply to every request that the kernel module
sends you? At first glance, this looks as if FUSE is waiting for your
filesystem to respond...


Best,
-Nikolaus
--
GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F

             »Time flies like an arrow, fruit flies like a Banana.«

------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/xeonphi
--
fuse-devel mailing list
To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel
Reply | Threaded
Open this post in threaded view
|

Re: application hangs on fuse module

yin zhuhua
Hi Nikolaus,

My fuse daemon stack is not working on any request and the fuse low level function is waiting request from fuse kernel module.

Thanks & Regards,
Zhuhua

On Thu, Dec 8, 2016 at 5:23 PM, Nikolaus Rath <[hidden email]> wrote:
Hi

On Dec 08 2016, yin zhuhua <[hidden email]> wrote:
> I got a wired application hang on fuse module as below. Did you see the
> same problem? I did not reproduce the problem using fusexmp_fh. The "-o
> direct_io" was enabled.
>
> [<ffffffffa17a8181>] wait_answer_interruptible+0x81/0xc0 [fuse]
>
> [<ffffffffa17a839b>] __fuse_request_send+0x1db/0x2b0 [fuse]
>
> [<ffffffffa17a8482>] fuse_request_send+0x12/0x20 [fuse]
>
> [<ffffffffa17aecc7>] fuse_send_write+0xe7/0x120 [fuse]
>
> [<ffffffffa17b14e3>] fuse_direct_io+0x3a3/0x7a0 [fuse]

Are you sure that you reply to every request that the kernel module
sends you? At first glance, this looks as if FUSE is waiting for your
filesystem to respond...


Best,
-Nikolaus
--
GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F

             »Time flies like an arrow, fruit flies like a Banana.«

------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/xeonphi
--
fuse-devel mailing list
To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel


------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/xeonphi
--
fuse-devel mailing list
To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel
Reply | Threaded
Open this post in threaded view
|

Re: application hangs on fuse module

Nikolaus Rath
Hi Yin,

Yes, that is likely. But are you certain that you have called
fuse_reply_* for all the requests that you are no longer working on?

Best,
-Nikolaus

On Dec 09 2016, yin zhuhua <[hidden email]> wrote:

> Hi Nikolaus,
>
> My fuse daemon stack is not working on any request and the fuse low level
> function is waiting request from fuse kernel module.
>
> Thanks & Regards,
> Zhuhua
>
> On Thu, Dec 8, 2016 at 5:23 PM, Nikolaus Rath <[hidden email]> wrote:
>
>> Hi
>>
>> On Dec 08 2016, yin zhuhua <yinzhuhua-Re5JQEeQqe8AvxtiuMwx3w@public.
>> gmane.org> wrote:
>> > I got a wired application hang on fuse module as below. Did you see the
>> > same problem? I did not reproduce the problem using fusexmp_fh. The "-o
>> > direct_io" was enabled.
>> >
>> > [<ffffffffa17a8181>] wait_answer_interruptible+0x81/0xc0 [fuse]
>> >
>> > [<ffffffffa17a839b>] __fuse_request_send+0x1db/0x2b0 [fuse]
>> >
>> > [<ffffffffa17a8482>] fuse_request_send+0x12/0x20 [fuse]
>> >
>> > [<ffffffffa17aecc7>] fuse_send_write+0xe7/0x120 [fuse]
>> >
>> > [<ffffffffa17b14e3>] fuse_direct_io+0x3a3/0x7a0 [fuse]
>>
>> Are you sure that you reply to every request that the kernel module
>> sends you? At first glance, this looks as if FUSE is waiting for your
>> filesystem to respond...
>>
>>
>> Best,
>> -Nikolaus
>> --
>> GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
>> Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F
>>
>>              »Time flies like an arrow, fruit flies like a Banana.«
>>
>> ------------------------------------------------------------
>> ------------------
>> Developer Access Program for Intel Xeon Phi Processors
>> Access to Intel Xeon Phi processor-based developer platforms.
>> With one year of Intel Parallel Studio XE.
>> Training and support from Colfax.
>> Order your platform today.http://sdm.link/xeonphi
>> --
>> fuse-devel mailing list
>> To unsubscribe or subscribe, visit https://lists.sourceforge.net/
>> lists/listinfo/fuse-devel
>>
> ------------------------------------------------------------------------------
> Developer Access Program for Intel Xeon Phi Processors
> Access to Intel Xeon Phi processor-based developer platforms.
> With one year of Intel Parallel Studio XE.
> Training and support from Colfax.
> Order your platform today.http://sdm.link/xeonphi
>
> --
> fuse-devel mailing list
> To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel
>


--
GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F

             »Time flies like an arrow, fruit flies like a Banana.«

------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/xeonphi
--
fuse-devel mailing list
To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel
Reply | Threaded
Open this post in threaded view
|

Re: application hangs on fuse module

yin zhuhua
Hi Nikolaus,

The problem is gone after I upgrade libfuse from 2.8.3 to 2.8.7. I think maybe that's problem of libfuse 2.8.3.

I am using fuse library high level API - fuse_main with initialized fuse_operations structure. Do I need to use fuse_reply_* methods? 

Thanks & Regards,
Zhuhua

On Fri, Dec 9, 2016 at 11:48 AM, Nikolaus Rath <[hidden email]> wrote:
Hi Yin,

Yes, that is likely. But are you certain that you have called
fuse_reply_* for all the requests that you are no longer working on?

Best,
-Nikolaus

On Dec 09 2016, yin zhuhua <[hidden email]> wrote:
> Hi Nikolaus,
>
> My fuse daemon stack is not working on any request and the fuse low level
> function is waiting request from fuse kernel module.
>
> Thanks & Regards,
> Zhuhua
>
> On Thu, Dec 8, 2016 at 5:23 PM, Nikolaus Rath <[hidden email]> wrote:
>
>> Hi
>>
>> On Dec 08 2016, yin zhuhua <yinzhuhua-Re5JQEeQqe8AvxtiuMwx3w@public.
>> gmane.org> wrote:
>> > I got a wired application hang on fuse module as below. Did you see the
>> > same problem? I did not reproduce the problem using fusexmp_fh. The "-o
>> > direct_io" was enabled.
>> >
>> > [<ffffffffa17a8181>] wait_answer_interruptible+0x81/0xc0 [fuse]
>> >
>> > [<ffffffffa17a839b>] __fuse_request_send+0x1db/0x2b0 [fuse]
>> >
>> > [<ffffffffa17a8482>] fuse_request_send+0x12/0x20 [fuse]
>> >
>> > [<ffffffffa17aecc7>] fuse_send_write+0xe7/0x120 [fuse]
>> >
>> > [<ffffffffa17b14e3>] fuse_direct_io+0x3a3/0x7a0 [fuse]
>>
>> Are you sure that you reply to every request that the kernel module
>> sends you? At first glance, this looks as if FUSE is waiting for your
>> filesystem to respond...
>>
>>
>> Best,
>> -Nikolaus
>> --
>> GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
>> Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F
>>
>>              »Time flies like an arrow, fruit flies like a Banana.«
>>
>> ------------------------------------------------------------
>> ------------------
>> Developer Access Program for Intel Xeon Phi Processors
>> Access to Intel Xeon Phi processor-based developer platforms.
>> With one year of Intel Parallel Studio XE.
>> Training and support from Colfax.
>> Order your platform today.http://sdm.link/xeonphi
>> --
>> fuse-devel mailing list
>> To unsubscribe or subscribe, visit https://lists.sourceforge.net/
>> lists/listinfo/fuse-devel
>>
> ------------------------------------------------------------------------------
> Developer Access Program for Intel Xeon Phi Processors
> Access to Intel Xeon Phi processor-based developer platforms.
> With one year of Intel Parallel Studio XE.
> Training and support from Colfax.
> Order your platform today.http://sdm.link/xeonphi
>
> --
> fuse-devel mailing list
> To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel
>


--
GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F

             »Time flies like an arrow, fruit flies like a Banana.«

------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/xeonphi
--
fuse-devel mailing list
To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel


------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/xeonphi
--
fuse-devel mailing list
To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel
Reply | Threaded
Open this post in threaded view
|

Re: application hangs on fuse module

Nikolaus Rath
On Dec 09 2016, yin zhuhua <[hidden email]> wrote:
> Hi Nikolaus,
>
> The problem is gone after I upgrade libfuse from 2.8.3 to 2.8.7. I think
> maybe that's problem of libfuse 2.8.3.

Good :-).

>
> I am using fuse library high level API - fuse_main with
> initialized fuse_operations structure. Do I need to use fuse_reply_*
> methods?

No, sorry. I was assuming you're using the low-level API.


Best,
-Nikolaus

--
GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F

             »Time flies like an arrow, fruit flies like a Banana.«

------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/xeonphi
--
fuse-devel mailing list
To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel