黑骑士

博客导航

博客日历

«	七月 2008					»
一	二	三	四	五	六	日
	1	2	3	4	5	6
7	8	9	10	11	12	13
14	15	16	17	18	19	20
21	22	23	24	25	26	27
28	29	30	31

oracle as故障分析及处理

发表人:wzy25 | 发表时间: 2007年一月29日, 16:11

某保险公司生产环境oracle as集群出现不定期自动重启现象，严重影响业务，根据如下中间件日志，分析解决。

结论：分配给app得heap 不够，尤其是new generation不够，导致jdk做垃圾回收得时候无法完成回收工作，没有空闲的heap可以分配，时间花在gc上面，长时间业务无法响应。

解决方法：设置如下参数。

-server -Xms1500m -Xmx1500m -XX:NewSize=700m -
XX:MaxNewSize=700m -XX:SurvivorRatio=8 -XX:MaxPermSize=256m -XX:+UseParallelGC -XX:ParallelGCThre
ads=4 -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -verbose:gc -Xloggc:gc.log

最后得解决办法是分析程序，可能是程序分配了对象而没有及时销毁，导致heap耗尽。

07/01/25 09:23:48 at com.evermind.server.http.ResourceFilterChain.doFilter(ResourceFilterChain.java:65)
07/01/25 09:23:48 at com.ebao.pub.framework.AppFilter.doFilter(AppFilter.java:62)
07/01/25 09:23:48 at com.evermind.server.http.ServletRequestDispatcher.invoke(ServletRequestDispatcher.java:604)
07/01/25 09:23:48 at com.evermind.server.http.ServletRequestDispatcher.forwardInternal(ServletRequestDispatcher.java:317)
07/01/25 09:23:48 at com.evermind.server.http.HttpRequestHandler.processRequest(HttpRequestHandler.java:790)
07/01/25 09:23:48 at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:208)
07/01/25 09:23:48 at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:125)
07/01/25 09:23:48 at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:192)
07/01/25 09:23:48 at java.lang.Thread.run(Thread.java:534)
07/01/25 09:23:48 customer organ id is : 3380151
07/01/25 09:23:48 select * from (select rownum as my_rownum,table_a.* from(select DISTINCT a.*, c.*, d.INSURED_NUM,d.benefit_level from t_customer a, t_uw_insured d, (select insured_1 insurant_id,0 normal_prem,0 normal_stand,0 policy_prem,0 policy_stand,0 tax_prem,0 tax_prem_stand,sum(next_weak_prem) weak_prem,sum(next_weak_stand) weak_stand,sum(next_disable_prem) disable_prem,sum(next_disable_stand) disable_stand,sum(next_job_prem) job_prem,sum(next_job_stand) job_stand,sum(period_prem) period_prem,sum(discount_prem) discount_prem,sum(AMOUNT) amount, sum(except_value) EXCEPT_VALUE ,insured_1,relation_1,relation_s,null job_1_1,null job_1_2,job_cate_1, null job_cate_1_2,em_life_1, em_health_1 from t_uw_product where underwrite_id=276433 group by insured_1,relation_1,relation_s,job_cate_1,em_life_1, em_health_1 ) c where a.customer_id = c.insured_1 and d.underwrite_id = 276433 and d.INSURED_ID = c.insured_1 order by INSURED_NUM) table_a where rownum<100) where my_rownum>=0
07/01/25 09:23:48 customer organ id is : 3007404
07/01/25 09:23:48 <?xml version="1.0" encoding="UTF-8" ?>
<deptmentlist>
<Count>1</Count>
<Deptment>
<RealName><![CDATA[????]]></RealName>
<DeptType>1</DeptType>
<OrganId>1032012</OrganId>
<Status>1</Status> <DeptCate>1</DeptCate> <DeptGrade>3</DeptGrade> <AreaType>null</AreaType> </Deptment>
</deptmentlist>

[Full GC [ParNew: 523834K->523834K(523840K), 0.0000420 secs][CMS[Unloading class sun.reflect.GeneratedMethodAccessor275]
[Unloading class sun.reflect.GeneratedMethodAccessor999]
[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor24]
[Unloading class sun.reflect.GeneratedMethodAccessor1073]
[Unloading class sun.reflect.GeneratedMethodAccessor972]
[Unloading class sun.reflect.GeneratedMethodAccessor1084]
[Unloading class sun.reflect.GeneratedMethodAccessor1061]
[Unloading class sun.reflect.GeneratedMethodAccessor971]
[Unloading class sun.reflect.GeneratedMethodAccessor980]
[Unloading class sun.reflect.GeneratedMethodAccessor1066]
[Unloading class sun.reflect.GeneratedMethodAccessor1057]
[Unloading class sun.reflect.GeneratedMethodAccessor986]
[Unloading class sun.reflect.GeneratedMethodAccessor978]
[Unloading class sun.reflect.GeneratedMethodAccessor967]
[Unloading class sun.reflect.GeneratedMethodAccessor964]
[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor25]
[Unloading class sun.reflect.GeneratedMethodAccessor1070]
[Unloading class sun.reflect.GeneratedMethodAccessor1072]
[Unloading class sun.reflect.GeneratedMethodAccessor1013]
[Unloading class sun.reflect.GeneratedMethodAccessor992]
[Unloading class sun.reflect.GeneratedMethodAccessor1011]
[Unloading class sun.reflect.GeneratedMethodAccessor1010]
[Unloading class sun.reflect.GeneratedMethodAccessor1051]
[Unloading class sun.reflect.GeneratedMethodAccessor1085]
[Unloading class sun.reflect.GeneratedMethodAccessor1003]
[Unloading class sun.reflect.GeneratedMethodAccessor970]
[Unloading class sun.reflect.GeneratedMethodAccessor1065]
[Unloading class sun.reflect.GeneratedMethodAccessor1062]
[Unloading class sun.reflect.GeneratedMethodAccessor969]
[Unloading class sun.reflect.GeneratedMethodAccessor1050]
[Unloading class sun.reflect.GeneratedMethodAccessor1080]
[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor22]
[Unloading class sun.reflect.GeneratedMethodAccessor987]
[Unloading class sun.reflect.GeneratedMethodAccessor1082]
[Unloading class sun.reflect.GeneratedMethodAccessor995]
[Unloading class sun.reflect.GeneratedMethodAccessor976]
[Unloading class sun.reflect.GeneratedMethodAccessor1068]
[Unloading class sun.reflect.GeneratedMethodAccessor1054]
[Unloading class sun.reflect.GeneratedMethodAccessor1012]
[Unloading class sun.reflect.GeneratedMethodAccessor988]
[Unloading class sun.reflect.GeneratedMethodAccessor1002]
[Unloading class sun.reflect.GeneratedMethodAccessor1049]
[Unloading class sun.reflect.GeneratedMethodAccessor963]
[Unloading class sun.reflect.GeneratedMethodAccessor1083]
[Unloading class sun.reflect.GeneratedMethodAccessor974]
[Unloading class sun.reflect.GeneratedMethodAccessor1058]
[Unloading class sun.reflect.GeneratedMethodAccessor1081]
[Unloading class sun.reflect.GeneratedMethodAccessor1008]
[Unloading class sun.reflect.GeneratedMethodAccessor1000]
[Unloading class sun.reflect.GeneratedMethodAccessor985]
[Unloading class sun.reflect.GeneratedMethodAccessor1006]
[Unloading class sun.reflect.GeneratedMethodAccessor1067]
[Unloading class sun.reflect.GeneratedMethodAccessor973]
[Unloading class sun.reflect.GeneratedMethodAccessor962]
[Unloading class sun.reflect.GeneratedMethodAccessor1001]
[Unloading class sun.reflect.GeneratedMethodAccessor1060]
[Unloading class sun.reflect.GeneratedMethodAccessor1077]
[Unloading class sun.reflect.GeneratedMethodAccessor966]
[Unloading class sun.reflect.GeneratedMethodAccessor991]
[Unloading class sun.reflect.GeneratedMethodAccessor975]
[Unloading class sun.reflect.GeneratedMethodAccessor1005]
[Unloading class sun.reflect.GeneratedMethodAccessor1004]
[Unloading class sun.reflect.GeneratedMethodAccessor1075]
[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor26]
[Unloading class sun.reflect.GeneratedMethodAccessor977]
[Unloading class sun.reflect.GeneratedMethodAccessor1088]
[Unloading class sun.reflect.GeneratedMethodAccessor1071]
[Unloading class sun.reflect.GeneratedMethodAccessor984]
[Unloading class sun.reflect.GeneratedMethodAccessor1007]
[Unloading class sun.reflect.GeneratedMethodAccessor994]
[Unloading class sun.reflect.GeneratedMethodAccessor981]
[Unloading class sun.reflect.GeneratedMethodAccessor1069]
[Unloading class sun.reflect.GeneratedMethodAccessor983]
[Unloading class sun.reflect.GeneratedMethodAccessor998]
[Unloading class sun.reflect.GeneratedMethodAccessor1052]
[Unloading class sun.reflect.GeneratedMethodAccessor993]
[Unloading class sun.reflect.GeneratedMethodAccessor1053]
[Unloading class sun.reflect.GeneratedMethodAccessor1076]
[Unloading class sun.reflect.GeneratedMethodAccessor1056]
[Unloading class sun.reflect.GeneratedMethodAccessor1059]
[Unloading class sun.reflect.GeneratedMethodAccessor1064]
[Unloading class sun.reflect.GeneratedMethodAccessor1079]
[Unloading class sun.reflect.GeneratedMethodAccessor989]
[Unloading class sun.reflect.GeneratedMethodAccessor990]
[Unloading class sun.reflect.GeneratedMethodAccessor979]
[Unloading class sun.reflect.GeneratedMethodAccessor968]
[Unloading class sun.reflect.GeneratedMethodAccessor1009]
[Unloading class sun.reflect.GeneratedMethodAccessor1086]
[Unloading class sun.reflect.GeneratedMethodAccessor1087]
[Unloading class sun.reflect.GeneratedMethodAccessor1074]
[Unloading class sun.reflect.GeneratedMethodAccessor996]
[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor23]
[Unloading class sun.reflect.GeneratedMethodAccessor965]
[Unloading class sun.reflect.GeneratedMethodAccessor982]
[Unloading class sun.reflect.GeneratedMethodAccessor1078]
[Unloading class sun.reflect.GeneratedMethodAccessor1055]
[Unloading class sun.reflect.GeneratedMethodAccessor1063]
[Unloading class sun.reflect.GeneratedMethodAccessor997]
: 524287K->524287K(524288K), 8.9523670 secs] 1048122K->1037691K(1048128K), [CMS Perm : 49222K->49056K(82708K)], 8.9525910 secs]
07/01/25 09:23:57
07/01/25 09:23:57 customer organ id is : 3360395
07/01/25 09:23:57 customer organ id is : 3702372
07/01/25 09:23:57 customer organ id is : 2928640
07/01/25 09:23:57 customer organ id is : 3385967
07/01/25 09:23:57 customer organ id is : 3085165
07/01/25 09:23:57 customer organ id is : 3007404
07/01/25 09:23:57 customer organ id is : 3363920
07/01/25 09:23:57 customer organ id is : 3702372
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000420 secs][CMS: 524287K->524288K(524288K), 8.9048900 secs] 1048127K->1039961K(1048128K), [CMS Perm : 49074K->49063K(82708K)], 8.9050980 secs]
07/01/25 09:24:06 customer organ id is : 4177442
07/01/25 09:24:06 customer organ id is : 3085165
07/01/25 09:24:06 customer organ id is : 2931882
07/01/25 09:24:06 customer organ id is : 3007404
07/01/25 09:24:06 customer organ id is : 3085165
07/01/25 09:24:06 customer organ id is : 2931882
07/01/25 09:24:06 customer organ id is : 3702372
07/01/25 09:24:06 customer organ id is : 3424191
07/01/25 09:24:06 customer organ id is : 4153582
07/01/25 09:24:06 customer organ id is : 4153582
07/01/25 09:24:06 customer organ id is : 4153582
07/01/25 09:24:06 customer organ id is : 3702600
07/01/25 09:24:06 customer organ id is : 3380151
07/01/25 09:24:06 customer organ id is : 3365945
07/01/25 09:24:06 customer organ id is : 3007404
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000400 secs][CMS[Unloading class sun.reflect.GeneratedMethodAccessor1181]
: 524288K->524287K(524288K), 8.9034640 secs] 1048127K->1041183K(1048128K), [CMS Perm : 49071K->49057K(82708K)], 8.9036780 secs]
07/01/25 09:24:15 customer organ id is : 3360395
[GC [1 CMS-initial-mark: 524287K(524288K)] 1046171K(1048128K), 1.3790940 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000420 secs][CMS[CMS-concurrent-mark: 3.013/3.025 secs]
: 524287K->524288K(524288K), 11.8429640 secs] 1048127K->1042643K(1048128K), [CMS Perm : 49068K->49058K(82708K)], 11.8431790 secs]
07/01/25 09:24:29 customer organ id is : 4177442
07/01/25 09:24:29 customer organ id is : 3702372
07/01/25 09:24:29 customer organ id is : 3702372
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000400 secs][CMS: 524288K->524287K(524288K), 8.9835420 secs] 1048127K->1045096K(1048128K), [CMS Perm : 49065K->49058K(82708K)], 8.9837680 secs]
[GC [1 CMS-initial-mark: 524287K(524288K)] 1045096K(1048128K), 1.3717200 secs]
07/01/25 09:24:39 customer organ id is : 3007404
07/01/25 09:24:39 customer organ id is : 3385967
07/01/25 09:24:39 customer organ id is : 2950568
07/01/25 09:24:39 customer organ id is : 3365945
07/01/25 09:24:39 customer organ id is : 3728080
07/01/25 09:24:39 customer organ id is : 3386363
07/01/25 09:24:39 customer organ id is : 3365945
07/01/25 09:24:39 customer organ id is : 2928655
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000420 secs][CMS[CMS-concurrent-mark: 3.256/3.262 secs]
: 524287K->524288K(524288K), 11.8559910 secs] 1048127K->1047252K(1048128K), [CMS Perm : 49060K->49057K(82708K)], 11.8562040 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000410 secs][CMS: 524288K->524288K(524288K), 8.9286710 secs] 1048127K->1047796K(1048128K), [CMS Perm : 49065K->49060K(82708K)], 8.9288890 secs]
[Full GC [ParNew: 523508K->523508K(523840K), 0.0000340 secs][CMS: 524288K->524288K(524288K), 6.8213530 secs] 1047796K->1047794K(1048128K), [CMS Perm : 49060K->49060K(82708K)], 6.8215400 secs]
07/01/25 09:25:07 customer organ id is : 3360395
07/01/25 09:25:07 customer organ id is : 3380151
07/01/25 09:25:07 customer organ id is : 3085165
07/01/25 09:25:07 customer organ id is : 3702372
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000420 secs][CMS: 524288K->524288K(524288K), 8.9155330 secs] 1048127K->1047956K(1048128K), [CMS Perm : 49063K->49062K(82708K)], 8.9157550 secs]
[Full GC [ParNew: 523668K->523668K(523840K), 0.0000390 secs][CMS: 524288K->524288K(524288K), 6.8232330 secs] 1047956K->1047945K(1048128K), [CMS Perm : 49062K->49062K(82708K)], 6.8234250 secs]
07/01/25 09:25:23 java.lang.OutOfMemoryError
07/01/25 09:25:23 customer organ id is : 3702372
07/01/25 09:25:23 customer organ id is : 3012412
07/01/25 09:25:23 customer organ id is : 3032579
07/01/25 09:25:23 customer organ id is : 4177442
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000400 secs][CMS: 524288K->524287K(524288K), 8.9651100 secs] 1048127K->1047997K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 8.9653240 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000420 secs][CMS: 524287K->524287K(524288K), 7.4573380 secs] 1048127K->1048066K(1048128K), [CMS Perm : 49064K->49064K(82708K)], 7.4575430 secs]
[Full GC [ParNew: 523833K->523833K(523840K), 0.0000410 secs][CMS: 524287K->524287K(524288K), 7.2174150 secs] 1048121K->1048083K(1048128K), [CMS Perm : 49064K->49064K(82708K)], 7.2176340 secs]
[Full GC [ParNew: 523795K->523795K(523840K), 0.0000340 secs][CMS: 524287K->524287K(524288K), 6.8268840 secs] 1048083K->1048082K(1048128K), [CMS Perm : 49064K->49064K(82708K)], 6.8270700 secs]
07/01/25 09:25:39 customer organ id is : 3283473
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000410 secs][CMS: 524287K->524288K(524288K), 8.9957410 secs] 1048127K->1048096K(1048128K), [CMS Perm : 49064K->49064K(82708K)], 8.9959570 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000410 secs][CMS: 524288K->524288K(524288K), 8.9625880 secs] 1048127K->1048110K(1048128K), [CMS Perm : 49065K->49065K(82708K)], 8.9627960 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000410 secs][CMS: 524288K->524288K(524288K), 7.2094770 secs] 1048127K->1048113K(1048128K), [CMS Perm : 49065K->49065K(82708K)], 7.2096810 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000410 secs][CMS: 524288K->524288K(524288K), 7.0870580 secs] 1048127K->1048116K(1048128K), [CMS Perm : 49065K->49065K(82708K)], 7.0872640 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000820 secs][CMS: 524288K->524288K(524288K), 8.9088590 secs] 1048127K->1048116K(1048128K), [CMS Perm : 49065K->49063K(82708K)], 8.9091090 secs]
[Full GC [ParNew: 523840K->523840K(523840K), 0.0000410 secs][CMS: 524288K->524288K(524288K), 7.2208930 secs] 1048128K->1048114K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 7.2211060 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000410 secs][CMS: 524288K->524288K(524288K), 7.1762840 secs] 1048127K->1048122K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 7.1764890 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000410 secs][CMS: 524288K->524288K(524288K), 6.8156290 secs] 1048127K->1048122K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 6.8158350 secs]
[Full GC [ParNew: 523834K->523834K(523840K), 0.0000340 secs][CMS: 524288K->524288K(524288K), 6.8220170 secs] 1048122K->1048122K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 6.8222000 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000410 secs][CMS
--------
07/01/25 09:27:09 Stop process
--------
: 524288K->524288K(524288K), 6.9478010 secs] 1048127K->1048114K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 6.9480060 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000410 secs][CMS: 524288K->524287K(524288K), 8.1837580 secs] 1048127K->1048118K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 8.1839640 secs]
[Full GC [ParNew: 523840K->523840K(523840K), 0.0000410 secs][CMS: 524287K->524287K(524288K), 6.8395130 secs] 1048127K->1048118K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 6.8397250 secs]
[Full GC [ParNew: 523832K->523832K(523840K), 0.0000420 secs][CMS: 524287K->524287K(524288K), 6.7812520 secs] 1048120K->1048119K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 6.7814630 secs]
[Full GC [ParNew: 523831K->523831K(523840K), 0.0000340 secs][CMS: 524287K->524287K(524288K), 6.7990460 secs] 1048119K->1048119K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 6.7992310 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000420 secs][CMS: 524287K->524287K(524288K), 8.9610750 secs] 1048127K->1048097K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 8.9612830 secs]
[Full GC [ParNew: 523809K->523809K(523840K), 0.0000330 secs][CMS: 524287K->524287K(524288K), 6.8331020 secs] 1048097K->1048096K(1048128K), [CMS Perm : 49063K->49063K(82708K)], 6.8332840 secs]
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000400 secs][CMS: 524287K->524288K(524288K), 10.6891740 secs] 1048127K->1048098K(1048128K), [CMS Perm : 49064K->49064K(82708K)], 10.6894170 secs]
[Full GC [ParNew: 523810K->523810K(523840K), 0.0000470 secs][CMS: 524288K->524288K(524288K), 8.3957040 secs] 1048098K->1048098K(1048128K), [CMS Perm : 49064K->49064K(82708K)], 8.3959210 secs]
07/01/25 09:25:54 customer organ id is : 3702372[Full GC [ParNew: 523839K->523839K(523840K), 0.0000420 secs][CMS: 524288K->524287K(524288K), 9.0428630 secs] 1048127K->1048123K(1048128K), [CMS Perm : 49064K->49064K(82708K)], 9.0430700 secs]
[Full GC [ParNew: 523835K->523835K(523840K), 0.0000340 secs][CMS: 524287K->524287K(524288K), 6.8153210 secs] 1048123K->1048122K(1048128K), [CMS Perm : 49064K->49064K(82708K)], 6.8155120 secs]
07/01/25 09:28:13 Error: Unable to find java:comp/ServerAdministrator: Lookup error: java.net.SocketException: Connection reset; nested exception is:
java.net.SocketException: Connection reset
com.evermind.client.orion.AdminCommandException: Unable to find java:comp/ServerAdministrator: Lookup error: java.net.SocketException: Connection reset; nested exception is:
java.net.SocketException: Connection reset
at com.evermind.client.orion.Oc4jAdminConsole.executeCommand(Oc4jAdminConsole.java:105)
at com.evermind.client.orion.Oc4jAdminConsole.main(Oc4jAdminConsole.java:27)
javax.naming.NamingException: Lookup error: java.net.SocketException: Connection reset; nested exception is:
java.net.SocketException: Connection reset [Root exception is java.net.SocketException: Connection reset]
at com.evermind.server.rmi.RMIContext.lookup(RMIContext.java:153)
at com.evermind.client.orion.Oc4jAdminConsole.executeCommand(Oc4jAdminConsole.java:102)
at com.evermind.client.orion.Oc4jAdminConsole.main(Oc4jAdminConsole.java:27)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:168)
at com.evermind.io.SingleReadBufferInputStream.readChunk(SingleReadBufferInputStream.java:116)
at com.evermind.io.SingleReadBufferInputStream.read(SingleReadBufferInputStream.java:35)
at com.evermind.server.rmi.RMIConnection.connect(RMIConnection.java:2366)
at com.evermind.server.rmi.RMIConnection.connect(RMIConnection.java:2219)
at com.evermind.server.rmi.RMIConnection.lookup(RMIConnection.java:1685)
at com.evermind.server.rmi.RMIServer.lookup(RMIServer.java:727)
at com.evermind.server.rmi.RMIContext.lookup(RMIContext.java:134)
... 2 more
---- Embedded exception
java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:168)
at com.evermind.io.SingleReadBufferInputStream.readChunk(SingleReadBufferInputStream.java:116)
at com.evermind.io.SingleReadBufferInputStream.read(SingleReadBufferInputStream.java:35)
at com.evermind.server.rmi.RMIConnection.connect(RMIConnection.java:2366)
at com.evermind.server.rmi.RMIConnection.connect(RMIConnection.java:2219)
at com.evermind.server.rmi.RMIConnection.lookup(RMIConnection.java:1685)
at com.evermind.server.rmi.RMIServer.lookup(RMIServer.java:727)
at com.evermind.server.rmi.RMIContext.lookup(RMIContext.java:134)
at com.evermind.client.orion.Oc4jAdminConsole.executeCommand(Oc4jAdminConsole.java:102)
at com.evermind.client.orion.Oc4jAdminConsole.main(Oc4jAdminConsole.java:27)
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000450 secs][CMS: 524288K->524287K(524288K), 8.8809180 secs] 1048127K->1048079K(1048128K), [CMS Perm : 49064K->49064K(82708K)], 8.8811320 secs]
java.lang.OutOfMemoryError
[Full GC [ParNew: 523839K->523839K(523840K), 0.0000420 secs][CMS: 524288K->524287K(524288K), 9.0173850 secs] 1048127K->1048077K(1048128K), [CMS Perm : 49064K->49063K(82708K)], 9.0176090 secs]
[Full GC [ParNew: 523840K->523840K(523840K), 0.0000440 secs][CMS: 524287K->524288K(524288K), 8.2310880 secs] 1048127K->1048065K(1048128K), [CMS Perm : 49065K->49065K(82708K)], 8.2313040 secs]
[Full GC [ParNew: 523834K->523834K(523840K), 0.0000420 secs][CMS: 524288K->524287K(524288K), 7.8984800 secs] 1048122K->1048067K(1048128K), [CMS Perm : 49065K->49065K(82708K)], 7.8986940 secs]
[Full GC [ParNew: 523779K->523779K(523840K), 0.0000340 secs][CMS
--------
07/01/25 09:29:11 Start process
--------
[Full GC [ParNew: 22736K->0K(523840K), 0.0279500 secs][CMS: 1521K->1517K(524288K), 0.1175990 secs] 22736K->1517K(1048128K), [CMS Perm : 7225K->7213K(16384K)], 0.1457610 secs]
07/01/25 09:29:14 Error starting ORMI-Server. Unable to bind socket: Address already in use
07/01/25 09:29:15 HttpApplication Descriptor started with id=882004154
07/01/25 09:29:15 Application default (default) initialized...
07/01/25 09:29:15 Application BC4J (bc4j) initialized...
07/01/25 09:29:15 Binding EJB BC4JManager to BC4JManager...
07/01/25 09:29:15 Application BC4JManager (BC4JManager) initialized...
07/01/25 09:29:15 Application IsWebCacheWorking (Is Web Cache Working) initialized...
07/01/25 09:29:15 Application life (ebao life insurance application) initialized...
07/01/25 09:29:15 Warning: Error reading transaction-log file (/ulic/ias10g/product/hzlife/j2ee/home/persistence/home_default_island_1/transaction.state) for recovery: premature end of file
07/01/25 09:29:15 Forced or abrupt (crash etc) server shutdown detected, starting recovery process...
07/01/25 09:29:15 Recovery completed, 0 connections committed and 0 rolled back...
07/01/25 09:29:25 Web-App default:defaultWebApp (0.0.0.0/0.0.0.0:3301/j2ee) started...
07/01/25 09:29:25 Warning: web-application 'default - defaultWebApp' is configured to be clustered, but it is not marked as distributable (containing a <distributable /> tag) in it's web.xml (file:/ulic/ias10g/product/hzlife/j2ee/home/default-web-app/WEB-INF/web.xml).This will result in load balancing but no failover(no replication) for this application.
07/01/25 09:29:25 Building Global TagLibrary Persistent Cache
07/01/25 09:29:25 Looking for global resource at /ulic/ias10g/product/hzlife/j2ee/home/config/../../../uix/taglibLooking for global resource at /ulic/ias10g/product/hzlife/j2ee/home/config/../../../j2ee/home/jsp/lib/taglibDone getting application current resources
07/01/25 09:29:25 Done initializing cache
07/01/25 09:29:25 Refreshing global cache - from existing cache ...
07/01/25 09:29:25 Building Application TagLibrary Persistent Cache for defaultWebApp
07/01/25 09:29:25 Done getting application current resources
07/01/25 09:29:25 Done initializing cache
07/01/25 09:29:25 Refreshing application cache - from existing cache ...
07/01/25 09:29:26 Found 0 listeners
07/01/25 09:29:26 Web-App default:dms (0.0.0.0/0.0.0.0:3301/dmsoc4j) started...
07/01/25 09:29:26 Warning: web-application 'default - dms' is configured to be clustered, but it is not marked as distributable (containing a <distributable /> tag) in it's web.xml (file:/ulic/ias10g/product/hzlife/j2ee/home/applications/dms/WEB-INF/web.xml).This will result in load balancing but no failover(no replication) for this application.
07/01/25 09:29:26 Building Application TagLibrary Persistent Cache for dms
07/01/25 09:29:26 Done getting application current resources
07/01/25 09:29:26 Done initializing cache
07/01/25 09:29:26 Refreshing application cache - from existing cache ...
07/01/25 09:29:26 Found 0 listeners
07/01/25 09:29:26 Web-App BC4J:cabo (0.0.0.0/0.0.0.0:3301/cabo) started...
07/01/25 09:29:26 Building Application TagLibrary Persistent Cache for cabo
07/01/25 09:29:26 Done getting application current resources
07/01/25 09:29:26 Done initializing cache
07/01/25 09:29:26 Refreshing application cache - from existing cache ...
07/01/25 09:29:26 Found 0 listeners
07/01/25 09:29:26 Web-App BC4J:webapp (0.0.0.0/0.0.0.0:3301/webapp) started...
07/01/25 09:29:26 Building Application TagLibrary Persistent Cache for webapp
07/01/25 09:29:26 Done getting application current resources
07/01/25 09:29:26 Done initializing cache
07/01/25 09:29:26 Refreshing application cache - from existing cache ...
07/01/25 09:29:26 Found 0 listeners
07/01/25 09:29:26 Web-App IsWebCacheWorking:IsWebCacheWorkingWeb (0.0.0.0/0.0.0.0:3301/IsWebCacheWorking) started...
07/01/25 09:29:26 Building Application TagLibrary Persistent Cache for IsWebCacheWorkingWeb
07/01/25 09:29:26 Done getting application current resources
07/01/25 09:29:26 Done initializing cache
07/01/25 09:29:26 Refreshing application cache - from existing cache ...
07/01/25 09:29:26 Found 0 listeners
07/01/25 09:29:26 Web-App life:web (0.0.0.0/0.0.0.0:3301/life) started...
07/01/25 09:29:26 Warning: web-application 'ebao life insurance application - web' is configured to be clustered, but it is not marked as distributable (containing a <distributable /> tag) in it's web.xml (file:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/web.xml).This will result in load balancing but no failover(no replication) for this application.
07/01/25 09:29:27 Building Application TagLibrary Persistent Cache for web
07/01/25 09:29:28 Done getting application current resources
07/01/25 09:29:28 Done initializing cache
07/01/25 09:29:28 Refreshing application cache - from existing cache ...
07/01/25 09:29:28 Found 0 listeners
07/01/25 09:29:28 DevUseActionServlet init!
07/01/25 09:29:28 init
07/01/25 09:29:28 log4j:WARN No appenders could be found for logger (org.apache.struts.util.PropertyMessageResources).
07/01/25 09:29:28 log4j:WARN Please initialize the log4j system properly.
07/01/25 09:29:30 ebao distroy action servlet before init
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 datasource_config: /WEB-INF/datasource.xml
07/01/25 09:29:30 [DEBUG]
07/01/25 09:29:30 DataSource jndi configuration ok.
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 action_config: /WEB-INF/action/
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 action_config getAllURL= []
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 realActionPath= /ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/action/
07/01/25 09:29:30 [DEBUG]
07/01/25 09:29:30 configure file: filename[/ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/action/].
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 ActionServlet Initialization finished
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 default_report_page: /ulic/report/ps/common/show_report.jsp
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 errorPage: /error.jsp
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 datasource_config: null
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 report_config: /WEB-INF/report/
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 report_config getAllURL= [file:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/report/individual/hesitate-cancel-report.xml, file:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/report/product/accountvalueremain/report_accountvalue.xml, file:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/report/ps/report_dailystatistic.xml, file:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/report/ps/report_refuselist.xml, file:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/report/ps/report_answertellist.xml, file:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/report/ps/report_cancelcontract.xml, file:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/report/ps/report_answerlist.xml, file:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/web/WEB-INF/report/agent/fin-agent-monRpt.xml]
07/01/25 09:29:30 [DEBUG]
07/01/25 09:29:30 report loaded:resultlistrpt
07/01/25 09:29:30 [DEBUG]
07/01/25 09:29:30 report loaded:accountvaluerpt
07/01/25 09:29:30 [DEBUG]
07/01/25 09:29:30 report loaded:dailystatisticrpt
07/01/25 09:29:30 [DEBUG]
07/01/25 09:29:30 report loaded:refusereport
07/01/25 09:29:30 [DEBUG]
07/01/25 09:29:30 report loaded:answertelreport
07/01/25 09:29:30 [DEBUG]
07/01/25 09:29:30 report loaded:cancelcontractrpt
07/01/25 09:29:30 [DEBUG]
07/01/25 09:29:30 report loaded:answerlistrpt
07/01/25 09:29:30 [DEBUG]
07/01/25 09:29:30 report loaded:finAgentMonRpt
07/01/25 09:29:30 [INFO]
07/01/25 09:29:30 ReportServlet Initialization finished
07/01/25 09:29:30 07/01/25 09:29:30 java.lang.NullPointerExceptionOracle Application Server Containers for J2EE 10g (9.0.4.0.0) initialized

07/01/25 09:29:30 at com.evermind.server.rmi.RMIServer.run(RMIServer.java:470)
07/01/25 09:29:30 at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:186)
07/01/25 09:29:30 at java.lang.Thread.run(Thread.java:534)
07/01/25 09:30:11 log4j:ERROR Could not read configuration file [life_log4j.properties].
07/01/25 09:30:11 java.io.FileNotFoundException: life_log4j.properties (No such file or directory)
07/01/25 09:30:11 at java.io.FileInputStream.open(Native Method)
07/01/25 09:30:11 at java.io.FileInputStream.<init>(FileInputStream.java:106)
07/01/25 09:30:11 at java.io.FileInputStream.<init>(FileInputStream.java:66)
07/01/25 09:30:11 at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:297)
07/01/25 09:30:11 at org.apache.log4j.PropertyConfigurator.configure(PropertyConfigurator.java:315)
07/01/25 09:30:11 at com.ebao.life.bean.pub.common.Log.<clinit>(Log.java:37)
07/01/25 09:30:11 at com.ebao.pub.util.config.ConfigFileHelper.getConfigProperties(ConfigFileHelper.java:51)
07/01/25 09:30:11 at com.ebao.life.bean.pub.common.Env.<clinit>(Env.java:342)
07/01/25 09:30:11 at _index._jspService(_index.java:46)
07/01/25 09:30:11 at com.orionserver.http.OrionHttpJspPage.service(OrionHttpJspPage.java:56)
07/01/25 09:30:11 at oracle.jsp.runtimev2.JspPageTable.service(JspPageTable.java:347)
07/01/25 09:30:11 at oracle.jsp.runtimev2.JspServlet.internalService(JspServlet.java:509)
07/01/25 09:30:11 at oracle.jsp.runtimev2.JspServlet.service(JspServlet.java:413)
07/01/25 09:30:11 at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
07/01/25 09:30:11 at com.evermind.server.http.ResourceFilterChain.doFilter(ResourceFilterChain.java:65)
07/01/25 09:30:11 at com.ebao.pub.framework.AppFilter.doFilter(AppFilter.java:62)
07/01/25 09:30:11 at com.evermind.server.http.ServletRequestDispatcher.invoke(ServletRequestDispatcher.java:604)
07/01/25 09:30:11 at com.evermind.server.http.ServletRequestDispatcher.forwardInternal(ServletRequestDispatcher.java:317)
07/01/25 09:30:11 at com.evermind.server.http.HttpRequestHandler.processRequest(HttpRequestHandler.java:790)
07/01/25 09:30:11 at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:208)
07/01/25 09:30:11 at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:125)
07/01/25 09:30:11 at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:192)
07/01/25 09:30:11 at java.lang.Thread.run(Thread.java:534)
07/01/25 09:30:11 log4j:ERROR Ignoring configuration file [life_log4j.properties].
07/01/25 09:30:11 config.file.path=/ulic/ias10g/product/hzlife/j2ee/home/app_config/
07/01/25 09:30:11 config.appserver.instance.name=null
07/01/25 09:30:11 config.appserver.path=null
07/01/25 09:30:11 customer.company.name=UNION
07/01/25 09:30:11 config.stand_alone_app=false
07/01/25 09:30:11 APP_PATH:/ulic/ias10g/product/hzlife/j2ee/home
07/01/25 09:30:11 DB_OWNER:null
07/01/25 09:30:11 LOG_PROPERTIES:/ulic/ias10g/product/hzlife/j2ee/home/app_config/life_log4j.properties
07/01/25 09:30:11 CURRENCY_DEFAULT_FORMAT:null
07/01/25 09:30:11 DATE_DEFAULT_FORMAT:yyyy-MM-dd
07/01/25 09:30:11 TIME_DEFAULT_FORMAT:null
07/01/25 09:30:11 CACHE_CONFIG_FILE:/ulic/ias10g/product/hzlife/j2ee/home/app_config/cache-config.xml
07/01/25 09:30:11 CUR_WEB_SERVER_ADDRESS:null
07/01/25 09:30:11 APP_SERVER_TYPE:9iAS
07/01/25 09:30:11 JDBC_DATA_SOURCE:TxLife
07/01/25 09:30:11 WEB_APP_NAME:/life
07/01/25 09:30:11 EJB_INITIAL_CONTEXT_FACTORY_REMOTE:null
07/01/25 09:30:11 EJB_PROVIDER_URL_REMOTE:null
07/01/25 09:30:11 REMOTE_CONTEXT_INITIAL_CONTEXT_FACTORY:null
07/01/25 09:30:11 REMOTE_CONTEXT_PROVIDER_URL:null
07/01/25 09:30:11 FOP_RPT_TEMPLATE_PATH:null
07/01/25 09:30:11 RPT_SERVER:null
07/01/25 09:30:11 DEFAULT_LANGUAGE_ID:211
07/01/25 09:30:11 DEFAULT_MONEY_ID:1
07/01/25 09:30:11 TEA_KEY:null
07/01/25 09:30:11 LOG_SQL:false
07/01/25 09:30:11 LOG_PLSQL:false
07/01/25 09:30:11 LOG_CONNECTION:true
07/01/25 09:30:11 LOG_URL_ACCESS:false
07/01/25 09:30:11 LOG_CONTEXT:com.ebao.life
07/01/25 09:30:11 FOP_USER_CONFIG_FILE:/ulic/ias10g/product/hzlife/j2ee/home/life_lib/fop/conf/userconfig.xml
07/01/25 09:30:11 IMAGE_LOCATION:2
07/01/25 09:30:11 IMAGE_PATH:/ulic/image_file/image_life
07/01/25 09:30:11 ARCHIVE_IMAGE_PATH:/ulic/image_file2/image_life
07/01/25 09:30:11 RPT_FILE_PATH:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/report/rptfile
07/01/25 09:30:11 OLAP_DATA_SOURCE:DSLifeOLAP
07/01/25 09:30:11 URL_PREFIX:/life
07/01/25 09:30:11 ENV_FLAG:1
07/01/25 09:30:11 NON_POOL_DB_URL:jdbc:oracle:thin:@10.16.1.2:1526:ulprd
07/01/25 09:30:11 NON_POOL_DB_USERNAME:ulprdapp
07/01/25 09:30:11 NON_POOL_DB_PASSWORD:tgxctgx0110
07/01/25 09:30:11 APP_SERVER_PRINCIPAL:null
07/01/25 09:30:11 APP_SERVER_CREDENTIALS:null
07/01/25 09:30:11 USE_TEAM_DEV_SUPPORT_ADAPTER:false
07/01/25 09:30:11 Env init end ......
07/01/25 09:30:11 oracle report user id:null
07/01/25 09:30:11 report archive temporary directory:null
07/01/25 09:30:11 report archive server ip:null
07/01/25 09:30:11 report archive directory:null
07/01/25 09:30:11 instance ip:null
07/01/25 09:30:11 instance ip:DB
07/01/25 09:30:11 CUR_WEB_SERVER:null
07/01/25 09:30:11 sDebug:true
07/01/25 09:30:11 HEAD_ID:1
07/01/25 09:30:11 JDBC_IMAGE_DATA_SOURCE:null
07/01/25 09:30:11 PRINCIPAL:jazn.com/admin
07/01/25 09:30:11 CREDENTIALS:456
07/01/25 09:30:11 EJB_INITIAL_CONTEXT_FACTORY:null
07/01/25 09:30:11 EJB_PROVIDER_URL:null
07/01/25 09:30:11 JDBC_INITIAL_CONTEXT_FACTORY:com.evermind.server.rmi.RMIInitialContextFactory
07/01/25 09:30:11 JDBC_PROVIDER_URL:opmn:ormi://10.16.3.1:6003:home/life
07/01/25 09:30:11 TRANSACTION_INITIAL_CONTEXT_FACTORY:com.evermind.server.rmi.RMIInitialContextFactory
07/01/25 09:30:11 TRANSACTION_PROVIDER_URL:opmn:ormi://10.16.3.1:6003:home/life
07/01/25 09:30:11 SERVLET_PREFIX:/life
07/01/25 09:30:11 CHECK_URL_ACCESS:true
07/01/25 09:30:11 REPORT_ROOT:/ulic/ias10g/product/hzlife/j2ee/home/applications/life
07/01/25 09:30:11 FORWARD_JSP_PATH_TRIM:/life
07/01/25 09:30:11 MENU_TYPE:NEW
07/01/25 09:30:11 REPORT_SERVER:null
07/01/25 09:30:11 DEFAULT_CHARSET:GBK
07/01/25 09:30:11 RESOURCE_DIR:resource
07/01/25 09:30:11 ORG_CHARSET:GBK
07/01/25 09:30:11 USE_NON_POOL_CONNECTION:false
07/01/25 09:30:11 HAS_IMAGE:true
07/01/25 09:30:11 HAS_UNDERWRITING:true
07/01/25 09:30:11 PRODUCTION_MODE:true
07/01/25 09:30:11 QUERY_DISPLAY_DB_FIELD_NAME:true
07/01/25 09:30:11 COMPANY_NAME:UNION
07/01/25 09:30:11 TEMP_PATH:life_tmp
07/01/25 09:30:11 USE_JDBC_TRANSACTION:false
07/01/25 09:30:11 HIBERNATE_HBM_PATH:/ulic/ias10g/product/hzlife/j2ee/home/applications/life/report/hibernate
07/01/25 09:30:11 IS_BATCH_ENV:false
07/01/25 09:30:11 OUT_ENTRY_DATA_PATH:/ulic/outentrys/YinwangData/Recieve/
07/01/25 09:30:11 OUT_ENTRY_FEEDBACK_PATH:/ulic/outentrys/YinwangData/FeedBack/
07/01/25 09:30:11 OUT_ENTRY_USER_NAME:yinwang
07/01/25 09:30:11 OUT_ENTRY_DATA_BACKUP_PATH:/ulic/outentrys/YinwangData/Recieve/Backup/
07/01/25 09:30:11 ENABLE_SESSION_TRACE:true
07/01/25 09:30:11 RETURN_RECEIPT_OUT_ENTRY_DATA_PATH:/ulic/outentrys/YinwangData/receiptdata/
07/01/25 09:30:11 RETURN_RECEIPT_OUT_ENTRY_FEEDBACK_PATH:/ulic/outentrys/YinwangData/receiptfeedback/
07/01/25 09:30:11 RETURN_RECEIPT_OUT_ENTRY_BACKUP_PATH:/ulic/outentrys/YinwangData/receiptbackup/

[回复]

太专业了，无比崇敬啊，旋转着晕倒……

麦小兔 | 09/03/2007, 22:40

free in bed with faith [回复]

body buffie clap
[url=http://userpoint.awesomewebspace.com/userpoint/mad-thumbs.html]brazil mike sol[/url]

hdfihfiosjkoI | 30/11/2007, 01:01

domain kari karisweets sweet [回复]

crista nicole wallpaper
[url=http://userpoint.freehyperspace2.com/userpoint/lane-meatholes-tory.html]krista allen haunted sea[/url]

hdfihfiosjkoII | 30/11/2007, 09:58

pure dee xxx [回复]

[url=http://userpoint.2222mb.com/userpoint/mindy-vega-wallpaper.html]breast exposed hilton paris[/url]

hdfihfiosjkoIII | 30/11/2007, 18:46

james mickie victoria wwe [回复]

[url=http://members.lycos.co.uk/userpoint/userpoint/fire-jada-sample.html]crista nicole wallpaper[/url]

hdfihfiosjkoIIII | 01/12/2007, 05:08

beautiful agony download [回复]

[url=http://members.lycos.co.uk/userpoint/userpoint/crista-nicole-wagner.html]body buffie da[/url]

hdfihfiosjkoIIII | 01/12/2007, 09:22

mindy vega nude pic [回复]

[url=http://userpoint.iifree.net/userpoint/allen-brian-krista.html]body buffie c god vs[/url]

hdfihfiosjkoIIIII | 01/12/2007, 18:32

Hello [回复]

Hello!
Nice site ;)
Bye

KillTorSlom | 23/01/2008, 12:09

alcohol and zithromax buy zithromax online zithromax produced by [回复]

alcohol and zithromax
buy zithromax online
zithromax produced by

zithromax facial pain feel better | 05/02/2008, 20:16

zithromax for cats zithromax zithromax as treatment for chlamydia [回复]

zithromax for cats
zithromax
zithromax as treatment for chlamydia

zithromax for urinary tract infection | 05/02/2008, 22:10

zithromax duration of action generic zithromax zithromax and glucose [回复]

zithromax duration of action
generic zithromax
zithromax and glucose

zithromax duration of action | 06/02/2008, 04:34

expired zithromax [url=http://www.1src.com/forums/member.php?u=92900]buy zithromax online[/url] next day garuantee cheap zithromax [回复]

expired zithromax
[url=http://www.1src.com/forums/member.php?u=92900]buy zithromax online[/url]
next day garuantee cheap zithromax

zithromax tri pak | 06/02/2008, 06:30

levaquin carbuncles levaquin latest news on zyvox [回复]

levaquin carbuncles
levaquin
latest news on zyvox

zithromax effects on gonorrhea | 06/02/2008, 11:59

what kind of drug is levaquin [url=http://forums.omnigroup.com/member.php?u=13045 ]levaquin generic[/url] linezolid stability [回复]

what kind of drug is levaquin
[url=http://forums.omnigroup.com/member.php?u=13045 ]levaquin generic[/url]
linezolid stability

antibiotic zithromax | 06/02/2008, 13:54

taking levaquin and cipro xr [url=http://www.janegreen.com/forums/member.php?u=865 ]buy levaquin[/url] levaquin tendonopathy lawsuits [回复]

taking levaquin and cipro xr
[url=http://www.janegreen.com/forums/member.php?u=865 ]buy levaquin[/url]
levaquin tendonopathy lawsuits

zithromax acute sinusitis facial pain feel better | 06/02/2008, 19:10

levaquin tablets [url=http://forum.bestechvideos.com/forums/1/topics/48 ]linezolid[/url] linezolid label [回复]

levaquin tablets
[url=http://forum.bestechvideos.com/forums/1/topics/48 ]linezolid[/url]
linezolid label

is zithromax good for vaginal infections | 06/02/2008, 21:15

levaquin dose for kidney infection [url=http://www.dealdatabase.com/forum/member.php?u=68723 ]buy levaquin[/url] levaquin levpac [回复]

levaquin dose for kidney infection
[url=http://www.dealdatabase.com/forum/member.php?u=68723 ]buy levaquin[/url]
levaquin levpac

zithromax austria | 07/02/2008, 02:50

is levaquin 500 mg glutenfrei levaquin levaquin solution [回复]

is levaquin 500 mg glutenfrei
levaquin
levaquin solution

zithromax susp | 07/02/2008, 04:44

[回复]

Bill | 29/02/2008, 14:20

[回复]

vh1 new york nude

Hero | 02/03/2008, 17:17

[回复]

printable trac

Diesel | 09/03/2008, 12:52

None [回复]

Article Opinion

viagra | 11/04/2008, 11:08

None [回复]

Article Opinion

ephedrine | 11/04/2008, 11:08

None [回复]

Article Opinion

ambien | 11/04/2008, 11:08

None [回复]

Article Opinion

lexapro | 11/04/2008, 11:08

LG adding Google to phones [回复]

LG adding Google to phones
LG Electronics Inc. said Wednesday it has reached an agreement with Google Inc. to offer the leading online search engine's products on its mobile phones.
http://technology.canoe.ca/Innovations/2007/03/28/3854067-ap.html

Arerkqsn | 04/05/2008, 05:04

[回复]

concrete loop gossip

Neo | 04/06/2008, 16:49

[回复]

concrete loop gossip

Kir | 04/06/2008, 18:05

None [回复]

Article Opinion

lexapro | 24/06/2008, 00:13

[回复]

talambuhay ni rizal tagalog version
rocco deluca tabs
www sponge bob com
conversion ml to ounce
yogi b lyric
country and western myspace layouts
kc smoker instruction book
gabriela montez
imitazioni orologi
deelish flavor of love 2
chainsaw pdf manuals
massaggi sesso alessandria
haircut bob bangs
chandigarh newspapers ajit
brando giorgi calendario
maliah michel pictures
kate nauta nude
siti seksi
bootz flavor of love pictures
6600 tema